Jul 03 13:39:48 devstack cinder-volume[75631]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 13:39:48 devstack cinder-volume[75631]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 13:39:48 devstack cinder-volume[75631]: we strongly recommend against using it for new projects. Jul 03 13:39:48 devstack cinder-volume[75631]: If you are already using Eventlet, we recommend migrating to a different Jul 03 13:39:48 devstack cinder-volume[75631]: framework. For more detail see Jul 03 13:39:48 devstack cinder-volume[75631]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 13:39:48 devstack cinder-volume[75631]: import eventlet # noqa Jul 03 13:39:50 devstack cinder-volume[75631]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:39:50 devstack cinder-volume[75631]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:39:50 devstack cinder-volume[75631]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:39:51 devstack cinder-volume[75631]: INFO dbcounter [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Registered counter for database cinder Jul 03 13:39:51 devstack cinder-volume[75631]: DEBUG oslo_db.sqlalchemy.engines [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75631) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:39:52 devstack cinder-volume[75631]: DEBUG dbcounter [-] [75631] Writer thread running {{(pid=75631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 13:39:52 devstack cinder-volume[75631]: INFO cinder.rpc [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 13:39:52 devstack cinder-volume[75631]: INFO cinder.rpc [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 13:39:52 devstack cinder-volume[75631]: DEBUG oslo_db.sqlalchemy.engines [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75631) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:39:52 devstack cinder-volume[75631]: INFO cinder.volume.manager [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Determined volume DB was empty at startup. Jul 03 13:39:52 devstack cinder-volume[75631]: DEBUG cinder.volume.manager [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75631) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jul 03 13:39:52 devstack cinder-volume[75631]: INFO cinder.volume.manager [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 13:39:52 devstack cinder-volume[75631]: WARNING stevedore.named [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 13:39:52 devstack cinder-volume[75631]: WARNING castellan.key_manager [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:39:52 devstack cinder-volume[75631]: WARNING cinder.keymgr.conf_key_mgr [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:39:52 devstack cinder-volume[75631]: DEBUG cinder.volume.drivers.lvm [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75631) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 03 13:39:52 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:52 devstack cinder-volume[75631]: DEBUG oslo_concurrency.processutils [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] CMD "cinder-rtstool verify" returned: 0 in 0.363s {{(pid=75631) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_db.sqlalchemy.engines [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75631) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:39:53 devstack cinder-volume[75631]: INFO cinder.rpc [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 03 13:39:53 devstack cinder-volume[75631]: INFO cinder.rpc [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 03 13:39:53 devstack cinder-volume[75631]: WARNING stevedore.named [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 13:39:53 devstack cinder-volume[75631]: WARNING castellan.key_manager [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:39:53 devstack cinder-volume[75631]: INFO cinder.volume.manager [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_db.sqlalchemy.engines [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75631) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:39:53 devstack cinder-volume[75631]: INFO oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Starting 1 workers Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Started child 75792 {{(pid=75631) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Full set of CONF: {{(pid=75631) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] ******************************************************************************** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Configuration options gathered from: {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] ================================================================================ {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] allow_availability_zone_fallback = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] allow_compression_on_image_upload = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75792]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] allowed_direct_url_schemes = [] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] api_rate_limit = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] auth_strategy = keystone {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] az_cache_duration = 3600 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_availability_zone = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_host = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_name = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_stats_polling_interval = 60 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backup_api_class = cinder.backup.api.API {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backup_name_template = backup-%s {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backup_use_same_host = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backup_use_temp_snapshot = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] chap_password = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] chap_username = {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cinder_internal_tenant_project_id = 31dfcb70f373444fb507bc0a5433c808 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cinder_internal_tenant_user_id = e37b0603c72242a09cba27f8fd55c05f {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cloned_volume_same_az = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cluster = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] compression_format = gzip {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] compute_api_class = cinder.compute.nova.API {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] config_dir = [] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] config_source = [] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] control_exchange = openstack {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] debug = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] default_availability_zone = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] default_group_type = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] default_volume_type = lvmdriver-1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] disk_geometry = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] driver_client_cert = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] driver_client_cert_key = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] driver_data_namespace = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] driver_ssl_cert_path = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] driver_ssl_cert_verify = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] driver_use_ssl = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] enable_force_upload = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] enable_new_services = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] enable_unsupported_driver = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] enabled_backends = ['lvmdriver-1'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] enforce_multipath_for_image_xfer = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] filter_function = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance_api_insecure = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance_api_servers = ['http://192.168.122.46/image'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance_api_ssl_compression = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance_ca_certificates_file = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance_catalog_info = image:glance:publicURL {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance_certfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance_keyfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance_num_retries = 3 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance_request_timeout = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] goodness_function = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] graceful_shutdown_timeout = 5 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] group_api_class = cinder.group.api.API {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] host = devstack {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] image_compress_on_upload = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] image_conversion_address_space_limit = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] image_conversion_cpu_limit = 60 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] image_conversion_disable = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] image_upload_use_cinder_backend = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] image_upload_use_internal_tenant = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] image_volume_cache_enabled = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] image_volume_cache_max_count = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] image_volume_cache_max_size_gb = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75792]: INFO cinder.volume.manager [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] init_host_max_objects_retrieval = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] instance_format = [instance: %(uuid)s] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] iscsi_target_flags = {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] iscsi_write_cache = on {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] iser_helper = tgtadm {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] iser_ip_address = 192.168.122.46 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] iser_port = 3260 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] log_color = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] log_config_append = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] log_dir = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] log_file = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] log_options = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] log_rotate_interval = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] log_rotate_interval_type = days {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] log_rotation_type = none {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] max_age = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] max_logfile_count = 30 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] max_logfile_size_mb = 200 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] max_over_subscription_ratio = 20.0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] message_reap_interval = 86400 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] message_ttl = 2592000 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] migration_create_volume_timeout_secs = 300 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] monkey_patch = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] monkey_patch_modules = [] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] my_ip = 192.168.122.46 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] no_snapshot_gb_quota = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] num_iser_scan_tries = 3 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] num_shell_tries = 3 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] num_volume_device_scan_tries = 3 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] nvmeof_conn_info_version = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] nvmet_ns_id = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] nvmet_port_id = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] osapi_max_limit = 1000 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] osapi_volume_ext_list = [] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] osapi_volume_listen = 0.0.0.0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] osapi_volume_listen_port = 8776 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] osapi_volume_use_ssl = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] osapi_volume_workers = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] per_volume_size_limit = -1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] periodic_fuzzy_delay = 60 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] periodic_interval = 60 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] project_id_regex = [0-9a-f\-]+ {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] public_endpoint = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] publish_errors = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] quota_backup_gigabytes = 1000 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] quota_backups = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] quota_gigabytes = 1000 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] quota_groups = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] quota_snapshots = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] quota_volumes = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] rate_limit_burst = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] rate_limit_except_level = CRITICAL {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] rate_limit_interval = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] reinit_driver_count = 3 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] replication_device = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] report_discard_supported = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] report_interval = 120 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] reservation_clean_interval = 86400 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] reservation_expire = 86400 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] reserved_image_namespaces = [] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] reserved_percentage = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] rpc_response_timeout = 120 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] run_external_periodic_tasks = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] scst_target_driver = iscsi {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] scst_target_iqn_name = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] service_down_time = 720 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] shell_completion = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] snapshot_name_template = snapshot-%s {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] snapshot_same_host = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] split_loggers = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] state_path = /opt/stack/data/cinder {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] storage_availability_zone = nova {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] storage_protocol = iSCSI {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] syslog_log_facility = LOG_USER {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] target_helper = lioadm {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] target_ip_address = 192.168.122.46 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] target_port = 3260 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] target_protocol = iscsi {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] target_secondary_ip_addresses = [] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] trace_flags = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] transfer_api_class = cinder.transfer.api.API {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] transport_url = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] until_refresh = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] use_chap_auth = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] use_default_quota_class = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] use_journal = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] use_json = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] use_multipath_for_image_xfer = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] use_stderr = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] use_syslog = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] verify_glance_signatures = enabled {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volume_api_class = cinder.volume.api.API {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volume_backend_name = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volume_clear = zero {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volume_clear_ionice = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volume_clear_size = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volume_copy_bps_limit = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volume_dd_blocksize = 1M {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volume_name_template = volume-%s {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volume_service_inithost_offload = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volume_usage_audit_period = month {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] zoning_mode = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_concurrency.disable_process_locking = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.auth_section = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.auth_type = password {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.auth_version = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.cache = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.certfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.delay_auth_decision = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.http_connect_timeout = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.include_service_catalog = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.insecure = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.interface = public {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.keyfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_password = {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcache_username = {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.region_name = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.service_token_roles_required = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.service_type = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.token_cache_time = 300 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.46/identity {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.backend = dogpile.cache.null {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.backend_argument = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.backend_expiration_time = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.config_prefix = cache.oslo {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.debug_cache_backend = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.enable_retry_client = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.enable_socket_keepalive = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.enabled = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.expiration_time = 600 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.hashclient_retry_attempts = 2 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack sudo[75796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 03 13:39:53 devstack sudo[75796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.memcache_dead_retry = 300 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.memcache_pool_maxsize = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.memcache_sasl_enabled = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.password = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.proxies = [] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.redis_db = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.redis_sentinel_service_name = mymaster {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.redis_server = localhost:6379 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.retry_attempts = 2 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.retry_delay = 0.0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.socket_keepalive_count = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.socket_keepalive_idle = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.socket_keepalive_interval = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.socket_timeout = 1.0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.tls_allowed_ciphers = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.tls_cafile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.tls_certfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.tls_enabled = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.tls_keyfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cache.username = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] coordination.backend_url = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.asyncio_connection = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.asyncio_slave_connection = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.backend = sqlalchemy {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.connection = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.connection_debug = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.connection_parameters = {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.connection_recycle_time = 3600 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.connection_trace = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.db_inc_retry_interval = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.db_max_retries = 20 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.db_max_retry_interval = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.db_retry_interval = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.max_overflow = 50 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.max_pool_size = 5 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.max_retries = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.mysql_wsrep_sync_wait = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.pool_timeout = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.retry_interval = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.slave_connection = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.sqlite_synchronous = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.synchronous_reader = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] database.use_db_reconnect = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler.connection_string = messaging:// {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler.enabled = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler.es_doc_type = notification {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler.es_scroll_size = 10000 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler.es_scroll_time = 2m {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler.filter_error_trace = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler.hmac_keys = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler.sentinel_service_name = mymaster {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler.socket_timeout = 0.1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler.trace_requests = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler.trace_sqlalchemy = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler_jaeger.process_tags = {} {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler_jaeger.service_name_prefix = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] profiler_otlp.service_name_prefix = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_policy.enforce_new_defaults = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_policy.enforce_scope = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_policy.policy_default_rule = default {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_policy.policy_file = policy.yaml {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_policy.remote_timeout = 60.0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] privsep_osbrick.group = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] privsep_osbrick.helper_command = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] privsep_osbrick.user = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cinder_sys_admin.group = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cinder_sys_admin.helper_command = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] cinder_sys_admin.user = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] service_user.auth_section = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] service_user.auth_type = password {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] service_user.cafile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] service_user.certfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] service_user.collect_timing = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] service_user.insecure = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] service_user.keyfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] service_user.send_service_user_token = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] service_user.split_loggers = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] service_user.timeout = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance.auth_section = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance.auth_type = password {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance.certfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance.collect_timing = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance.insecure = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance.keyfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance.region_name = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance.split_loggers = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] glance.timeout = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.backend_availability_zone = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.chap_password = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.chap_username = {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.disk_geometry = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.driver_client_cert = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.driver_client_cert_key = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.driver_data_namespace = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.driver_use_ssl = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.enable_unsupported_driver = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.extra_capabilities = {} {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.filter_function = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.goodness_function = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.iscsi_target_flags = {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.iscsi_write_cache = on {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.iser_helper = tgtadm {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.iser_ip_address = 192.168.122.46 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.iser_port = 3260 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.lvm_mirrors = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.lvm_share_target = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.lvm_type = auto {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.num_shell_tries = 3 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.nvmet_port_id = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.replication_device = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.report_discard_supported = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.reserved_percentage = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.scst_target_driver = iscsi {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.scst_target_iqn_name = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.storage_protocol = iSCSI {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.target_helper = tgtadm {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.target_ip_address = 192.168.122.46 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.target_port = 3260 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.target_protocol = iscsi {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.trace_flags = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.unique_fqdn_network = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.use_chap_auth = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.volume_backend_name = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.volume_clear = zero {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.volume_clear_ionice = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.volume_clear_size = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.volume_group = cinder-volumes {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_reports.file_event_handler = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_reports.log_dir = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.backend_availability_zone = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.backend_host = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.chap_password = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.chap_username = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.chiscsi_conf = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.disk_geometry = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.driver_client_cert = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.driver_data_namespace = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.driver_use_ssl = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.extra_capabilities = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.filter_function = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.goodness_function = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.iser_helper = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.iser_ip_address = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.iser_port = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.iser_target_prefix = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.lvm_conf_file = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.lvm_mirrors = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.lvm_share_target = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.lvm_type = auto {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.num_shell_tries = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.nvmet_port_id = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.replication_device = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.report_discard_supported = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.reserved_percentage = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.scst_target_driver = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.storage_protocol = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.target_helper = lioadm {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.target_ip_address = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.target_port = 3260 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.target_protocol = iscsi {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.trace_flags = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.use_chap_auth = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.volume_clear = zero {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.volume_clear_size = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] lvmdriver-1.volumes_dir = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.ssl = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.ssl_version = {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_notifications.driver = [] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_notifications.retry = -1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] oslo_messaging_notifications.transport_url = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] key_manager.fixed_key = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.barbican_api_version = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.barbican_endpoint = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.barbican_endpoint_type = public {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.barbican_region_name = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.cafile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.certfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.collect_timing = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.insecure = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.keyfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.number_of_retries = 60 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.retry_delay = 1 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.send_service_user_token = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.split_loggers = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.timeout = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.verify_ssl = True {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican.verify_ssl_path = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican_service_user.auth_section = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican_service_user.auth_type = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican_service_user.cafile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican_service_user.certfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican_service_user.collect_timing = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican_service_user.insecure = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican_service_user.keyfile = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican_service_user.split_loggers = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] barbican_service_user.timeout = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] vault.approle_role_id = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] vault.approle_secret_id = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] vault.kv_mountpoint = secret {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] vault.kv_path = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] vault.kv_version = 2 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] vault.namespace = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] vault.root_token_id = **** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] vault.ssl_ca_crt_file = None {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] vault.timeout = 60.0 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] vault.use_ssl = False {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:39:53 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] ******************************************************************************** {{(pid=75631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 13:39:53 devstack sudo[75796]: pam_unix(sudo:session): session closed for user root Jul 03 13:39:53 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:53 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:53 devstack sudo[76004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:39:53 devstack sudo[76004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:39:54 devstack sudo[76004]: pam_unix(sudo:session): session closed for user root Jul 03 13:39:54 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.659s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:54 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:39:54 devstack cinder-volume[75792]: INFO cinder.brick.local_dev.lvm [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 03 13:39:54 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:54 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:54 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:54 devstack sudo[76239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:39:54 devstack sudo[76239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:39:55 devstack sudo[76239]: pam_unix(sudo:session): session closed for user root Jul 03 13:39:55 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.812s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:55 devstack cinder-volume[75792]: DEBUG cinder.brick.local_dev.lvm [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75792) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 03 13:39:55 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:55 devstack sudo[76415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:39:55 devstack sudo[76415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:39:56 devstack sudo[76415]: pam_unix(sudo:session): session closed for user root Jul 03 13:39:56 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.107s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:56 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:56 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:56 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:56 devstack sudo[76567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:39:56 devstack sudo[76567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:39:57 devstack sudo[76567]: pam_unix(sudo:session): session closed for user root Jul 03 13:39:57 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:57 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:57 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:57 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:57 devstack sudo[76574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 03 13:39:57 devstack sudo[76574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:39:58 devstack sudo[76574]: pam_unix(sudo:session): session closed for user root Jul 03 13:39:58 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.814s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:58 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:58 devstack sudo[76577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:39:58 devstack sudo[76577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:39:59 devstack sudo[76577]: pam_unix(sudo:session): session closed for user root Jul 03 13:39:59 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.850s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:59 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:59 devstack sudo[76589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:39:59 devstack sudo[76589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:39:59 devstack sudo[76589]: pam_unix(sudo:session): session closed for user root Jul 03 13:39:59 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.832s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:39:59 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:39:59 devstack sudo[76595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:39:59 devstack sudo[76595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:00 devstack sudo[76595]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:00 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:00 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:00 devstack sudo[76602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:40:00 devstack sudo[76602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:01 devstack sudo[76602]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:01 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.721s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:01 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:01 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:01 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:01 devstack sudo[76610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:40:01 devstack sudo[76610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:02 devstack sudo[76610]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:02 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.825s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:02 devstack cinder-volume[75792]: INFO cinder.volume.drivers.lvm [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 03 13:40:02 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:02 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:02 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:02 devstack sudo[76725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:40:02 devstack sudo[76725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:02 devstack sudo[76725]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:02 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:02 devstack cinder-volume[75792]: DEBUG cinder.volume.drivers.lvm [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Updating volume stats {{(pid=75792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:40:02 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:02 devstack sudo[76732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:40:02 devstack sudo[76732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:03 devstack cinder-volume[75631]: DEBUG dbcounter [-] [75631] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:40:03 devstack sudo[76732]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:03 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:03 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:03 devstack sudo[76876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:40:03 devstack sudo[76876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:04 devstack sudo[76876]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:04 devstack sudo[76881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:40:04 devstack sudo[76881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:04 devstack sudo[76881]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.741s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:04 devstack sudo[76885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:40:04 devstack sudo[76885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:05 devstack sudo[76885]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:05 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:05 devstack cinder-volume[75792]: INFO cinder.volume.driver [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 13:40:05 devstack cinder-volume[75792]: DEBUG cinder.volume.driver [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75792) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jul 03 13:40:05 devstack cinder-volume[75792]: DEBUG oslo_db.sqlalchemy.engines [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:40:05 devstack cinder-volume[75792]: DEBUG dbcounter [-] [75792] Writer thread running {{(pid=75792) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 13:40:05 devstack cinder-volume[75792]: DEBUG cinder.db.sqlalchemy.api [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Building query based on filter {{(pid=75792) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 03 13:40:05 devstack cinder-volume[75792]: DEBUG cinder.image.image_utils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75792) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 03 13:40:05 devstack cinder-volume[75792]: INFO cinder.keymgr.migration [None req-7247d2de-c21f-4dd8-85c2-a228dacf97ee None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 13:40:05 devstack cinder-volume[75792]: DEBUG cinder.volume.drivers.lvm [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Updating volume stats {{(pid=75792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:40:05 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:05 devstack sudo[76890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:40:05 devstack sudo[76890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:06 devstack sudo[76890]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:06 devstack sudo[76896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:40:06 devstack sudo[76896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:07 devstack sudo[76896]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:07 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:07 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:07 devstack sudo[76900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:40:07 devstack sudo[76900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:07 devstack sudo[76900]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:07 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.750s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:07 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:07 devstack sudo[76904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:40:07 devstack sudo[76904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:08 devstack sudo[76904]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:08 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:08 devstack cinder-volume[75792]: DEBUG cinder.manager [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Notifying Schedulers of capabilities ... {{(pid=75792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:40:08 devstack cinder-volume[75792]: INFO cinder.volume.manager [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Driver initialization completed successfully. Jul 03 13:40:08 devstack cinder-volume[75792]: INFO cinder.manager [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Initiating service 2 cleanup Jul 03 13:40:08 devstack cinder-volume[75792]: INFO cinder.manager [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Service 2 cleanup completed. Jul 03 13:40:08 devstack cinder-volume[75792]: DEBUG cinder.service [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Creating RPC server for service cinder-volume {{(pid=75792) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 13:40:08 devstack cinder-volume[75792]: DEBUG cinder.service [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75792) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 13:40:08 devstack cinder-volume[75792]: INFO cinder.volume.manager [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 03 13:40:08 devstack cinder-volume[75792]: DEBUG cinder.volume.drivers.lvm [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Updating volume stats {{(pid=75792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:40:08 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:08 devstack sudo[76908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:40:08 devstack sudo[76908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:09 devstack sudo[76908]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:09 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.760s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:09 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:09 devstack sudo[76911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:40:09 devstack sudo[76911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:10 devstack sudo[76911]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:10 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:10 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:10 devstack sudo[76971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:40:10 devstack sudo[76971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:10 devstack sudo[76971]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:10 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:10 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:40:10 devstack sudo[76974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:40:10 devstack sudo[76974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:40:11 devstack sudo[76974]: pam_unix(sudo:session): session closed for user root Jul 03 13:40:11 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:40:11 devstack cinder-volume[75792]: INFO cinder.volume.manager [None req-dc02835d-238d-49a1-9653-ed007b6caa11 None None] Driver post RPC initialization completed successfully. Jul 03 13:40:21 devstack cinder-volume[75792]: DEBUG dbcounter [-] [75792] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75792) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:40:21 devstack cinder-volume[75792]: DEBUG dbcounter [-] [75792] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75792) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:41:04 devstack cinder-volume[75792]: DEBUG oslo_service.periodic_task [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75792) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:41:04 devstack cinder-volume[75792]: DEBUG cinder.volume.drivers.lvm [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Updating volume stats {{(pid=75792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:41:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:41:04 devstack sudo[78661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:41:04 devstack sudo[78661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:41:04 devstack sudo[78661]: pam_unix(sudo:session): session closed for user root Jul 03 13:41:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:41:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:41:04 devstack sudo[78664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:41:04 devstack sudo[78664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:41:05 devstack sudo[78664]: pam_unix(sudo:session): session closed for user root Jul 03 13:41:05 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:41:05 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:41:05 devstack sudo[78685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:41:05 devstack sudo[78685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:41:06 devstack sudo[78685]: pam_unix(sudo:session): session closed for user root Jul 03 13:41:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:41:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:41:06 devstack sudo[78688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:41:06 devstack sudo[78688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:41:06 devstack sudo[78688]: pam_unix(sudo:session): session closed for user root Jul 03 13:41:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:41:06 devstack cinder-volume[75792]: DEBUG cinder.manager [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Notifying Schedulers of capabilities ... {{(pid=75792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:42:04 devstack cinder-volume[75792]: DEBUG oslo_service.periodic_task [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75792) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:42:04 devstack cinder-volume[75792]: DEBUG cinder.volume.drivers.lvm [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Updating volume stats {{(pid=75792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:42:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:42:04 devstack sudo[79320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:42:04 devstack sudo[79320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:42:04 devstack sudo[79320]: pam_unix(sudo:session): session closed for user root Jul 03 13:42:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:42:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:42:04 devstack sudo[79323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:42:04 devstack sudo[79323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:42:05 devstack sudo[79323]: pam_unix(sudo:session): session closed for user root Jul 03 13:42:05 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:42:05 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:42:05 devstack sudo[79327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:42:05 devstack sudo[79327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:42:06 devstack sudo[79327]: pam_unix(sudo:session): session closed for user root Jul 03 13:42:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:42:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:42:06 devstack sudo[79357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:42:06 devstack sudo[79357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:42:06 devstack sudo[79357]: pam_unix(sudo:session): session closed for user root Jul 03 13:42:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:42:06 devstack cinder-volume[75792]: DEBUG cinder.manager [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Notifying Schedulers of capabilities ... {{(pid=75792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:42:21 devstack cinder-volume[75792]: DEBUG dbcounter [-] [75792] Writing DB stats cinder:SELECT=1 {{(pid=75792) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:42:21 devstack cinder-volume[75792]: DEBUG dbcounter [-] [75792] Writing DB stats cinder:UPDATE=1 {{(pid=75792) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:43:04 devstack cinder-volume[75792]: DEBUG oslo_service.periodic_task [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75792) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:43:04 devstack cinder-volume[75792]: DEBUG cinder.volume.drivers.lvm [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Updating volume stats {{(pid=75792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:43:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:43:04 devstack sudo[82335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:43:04 devstack sudo[82335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:43:04 devstack sudo[82335]: pam_unix(sudo:session): session closed for user root Jul 03 13:43:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:43:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:43:04 devstack sudo[82343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:43:04 devstack sudo[82343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:43:05 devstack sudo[82343]: pam_unix(sudo:session): session closed for user root Jul 03 13:43:05 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:43:05 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:43:05 devstack sudo[82346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:43:05 devstack sudo[82346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:43:06 devstack sudo[82346]: pam_unix(sudo:session): session closed for user root Jul 03 13:43:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:43:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:43:06 devstack sudo[82349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:43:06 devstack sudo[82349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:43:06 devstack sudo[82349]: pam_unix(sudo:session): session closed for user root Jul 03 13:43:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.768s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:43:06 devstack cinder-volume[75792]: DEBUG cinder.manager [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Notifying Schedulers of capabilities ... {{(pid=75792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:44:04 devstack cinder-volume[75792]: DEBUG oslo_service.periodic_task [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75792) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:44:04 devstack cinder-volume[75792]: DEBUG cinder.volume.drivers.lvm [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Updating volume stats {{(pid=75792) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 13:44:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:44:04 devstack sudo[84568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 13:44:04 devstack sudo[84568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:44:04 devstack sudo[84568]: pam_unix(sudo:session): session closed for user root Jul 03 13:44:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:44:04 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:44:04 devstack sudo[84582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:44:04 devstack sudo[84582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:44:05 devstack sudo[84582]: pam_unix(sudo:session): session closed for user root Jul 03 13:44:05 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:44:05 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:44:05 devstack sudo[84589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 13:44:05 devstack sudo[84589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:44:06 devstack sudo[84589]: pam_unix(sudo:session): session closed for user root Jul 03 13:44:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.590s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:44:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:44:06 devstack sudo[84592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 13:44:06 devstack sudo[84592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:44:06 devstack sudo[84592]: pam_unix(sudo:session): session closed for user root Jul 03 13:44:06 devstack cinder-volume[75792]: DEBUG oslo_concurrency.processutils [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=75792) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:44:06 devstack cinder-volume[75792]: DEBUG cinder.manager [None req-1b25a732-d5be-42ce-a16a-4d873de0a795 None None] Notifying Schedulers of capabilities ... {{(pid=75792) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:44:21 devstack cinder-volume[75792]: DEBUG dbcounter [-] [75792] Writing DB stats cinder:SELECT=1 {{(pid=75792) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:44:21 devstack cinder-volume[75792]: DEBUG dbcounter [-] [75792] Writing DB stats cinder:UPDATE=1 {{(pid=75792) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:45:03 devstack cinder-volume[75631]: INFO oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Caught SIGTERM, stopping children Jul 03 13:45:03 devstack cinder-volume[75631]: DEBUG oslo_concurrency.lockutils [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Acquiring lock "singleton_lock" {{(pid=75631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:45:03 devstack cinder-volume[75631]: DEBUG oslo_concurrency.lockutils [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Acquired lock "singleton_lock" {{(pid=75631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:45:03 devstack cinder-volume[75631]: DEBUG oslo_concurrency.lockutils [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Releasing lock "singleton_lock" {{(pid=75631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:45:03 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Stop services. {{(pid=75631) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 13:45:03 devstack cinder-volume[75631]: DEBUG oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Killing children. {{(pid=75631) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 13:45:03 devstack cinder-volume[75631]: INFO oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Waiting on 1 children to exit Jul 03 13:45:03 devstack cinder-volume[75792]: DEBUG oslo_concurrency.lockutils [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Acquiring lock "singleton_lock" {{(pid=75792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:45:03 devstack cinder-volume[75792]: DEBUG oslo_concurrency.lockutils [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Acquired lock "singleton_lock" {{(pid=75792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:45:03 devstack cinder-volume[75792]: DEBUG oslo_concurrency.lockutils [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Releasing lock "singleton_lock" {{(pid=75792) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:45:03 devstack cinder-volume[75792]: WARNING amqp [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 13:45:03 devstack cinder-volume[75792]: WARNING amqp [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 13:45:03 devstack cinder-volume[75631]: INFO oslo_service.backend._eventlet.service [None req-116b9a9f-008b-4c93-846c-4c1ed057455e None None] Child 75792 exited with status 0 Jul 03 13:45:03 devstack cinder-volume[85935]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 13:45:03 devstack cinder-volume[85935]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 13:45:03 devstack cinder-volume[85935]: we strongly recommend against using it for new projects. Jul 03 13:45:03 devstack cinder-volume[85935]: If you are already using Eventlet, we recommend migrating to a different Jul 03 13:45:03 devstack cinder-volume[85935]: framework. For more detail see Jul 03 13:45:03 devstack cinder-volume[85935]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 13:45:03 devstack cinder-volume[85935]: import eventlet # noqa Jul 03 13:45:06 devstack cinder-volume[85935]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:45:06 devstack cinder-volume[85935]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:45:06 devstack cinder-volume[85935]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:45:06 devstack cinder-volume[85935]: INFO dbcounter [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Registered counter for database cinder Jul 03 13:45:06 devstack cinder-volume[85935]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85935) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG dbcounter [-] [85935] Writer thread running {{(pid=85935) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 13:45:07 devstack cinder-volume[85935]: INFO cinder.rpc [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 13:45:07 devstack cinder-volume[85935]: INFO cinder.rpc [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85935) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:45:07 devstack cinder-volume[85935]: INFO cinder.volume.manager [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Determined volume DB was empty at startup. Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG cinder.volume.manager [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85935) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jul 03 13:45:07 devstack cinder-volume[85935]: INFO cinder.volume.manager [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 13:45:07 devstack cinder-volume[85935]: WARNING stevedore.named [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 13:45:07 devstack cinder-volume[85935]: WARNING castellan.key_manager [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:45:07 devstack cinder-volume[85935]: WARNING cinder.keymgr.conf_key_mgr [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:45:07 devstack cinder-volume[85935]: INFO cinder.volume.manager [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85935) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:45:07 devstack cinder-volume[85935]: INFO oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Starting 1 workers Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Started child 86149 {{(pid=85935) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Full set of CONF: {{(pid=85935) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] ******************************************************************************** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Configuration options gathered from: {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] ================================================================================ {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] allow_availability_zone_fallback = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] allow_compression_on_image_upload = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] allowed_direct_url_schemes = [] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[86149]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] api_rate_limit = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] auth_strategy = keystone {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_availability_zone = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_host = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_name = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_stats_polling_interval = 60 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backup_api_class = cinder.backup.api.API {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backup_name_template = backup-%s {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backup_use_same_host = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backup_use_temp_snapshot = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] chap_password = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] chap_username = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cinder_internal_tenant_project_id = 31dfcb70f373444fb507bc0a5433c808 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cinder_internal_tenant_user_id = e37b0603c72242a09cba27f8fd55c05f {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cluster = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] compression_format = gzip {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] compute_api_class = cinder.compute.nova.API {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] config_dir = [] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] config_source = [] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] control_exchange = openstack {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] debug = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] default_availability_zone = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] default_group_type = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] default_volume_type = QuobyteHD {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] disk_geometry = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] driver_client_cert = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] driver_client_cert_key = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] driver_data_namespace = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] driver_ssl_cert_path = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] driver_ssl_cert_verify = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] driver_use_ssl = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] enable_new_services = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] enable_unsupported_driver = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] enabled_backends = ['QuobyteHD'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] enforce_multipath_for_image_xfer = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] filter_function = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance_api_insecure = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance_api_servers = ['http://192.168.122.46/image'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance_api_ssl_compression = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance_ca_certificates_file = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance_catalog_info = image:glance:publicURL {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance_certfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[86149]: INFO cinder.volume.manager [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 13:45:07 devstack cinder-volume[86149]: DEBUG cinder.volume.drivers.remotefs [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86149) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance_keyfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance_num_retries = 3 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance_request_timeout = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] goodness_function = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] graceful_shutdown_timeout = 5 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] group_api_class = cinder.group.api.API {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] host = devstack {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] image_compress_on_upload = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] image_conversion_address_space_limit = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] image_conversion_cpu_limit = 60 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] image_conversion_disable = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] image_upload_use_cinder_backend = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] image_upload_use_internal_tenant = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] image_volume_cache_enabled = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] image_volume_cache_max_count = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] image_volume_cache_max_size_gb = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] init_host_max_objects_retrieval = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] instance_format = [instance: %(uuid)s] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] iscsi_target_flags = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] iscsi_write_cache = on {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] iser_helper = tgtadm {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] iser_ip_address = 192.168.122.46 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] iser_port = 3260 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] log_color = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] log_config_append = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] log_dir = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] log_file = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] log_options = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] log_rotate_interval = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] log_rotate_interval_type = days {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] log_rotation_type = none {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] max_age = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] max_logfile_count = 30 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] max_logfile_size_mb = 200 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] max_over_subscription_ratio = 20.0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] message_reap_interval = 86400 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] message_ttl = 2592000 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] migration_create_volume_timeout_secs = 300 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] monkey_patch = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] monkey_patch_modules = [] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] my_ip = 192.168.122.46 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] no_snapshot_gb_quota = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] num_iser_scan_tries = 3 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] num_shell_tries = 3 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] num_volume_device_scan_tries = 3 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] nvmeof_conn_info_version = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] nvmet_ns_id = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] nvmet_port_id = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] osapi_max_limit = 1000 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] osapi_volume_ext_list = [] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] osapi_volume_listen = 0.0.0.0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] osapi_volume_listen_port = 8776 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] osapi_volume_use_ssl = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] osapi_volume_workers = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] per_volume_size_limit = -1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] periodic_fuzzy_delay = 60 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] periodic_interval = 60 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] project_id_regex = [0-9a-f\-]+ {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] public_endpoint = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] publish_errors = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] quota_backup_gigabytes = 1000 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] quota_backups = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] quota_gigabytes = 1000 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] quota_groups = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] quota_snapshots = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] quota_volumes = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] rate_limit_burst = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] rate_limit_except_level = CRITICAL {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] rate_limit_interval = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] reinit_driver_count = 3 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] replication_device = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] report_discard_supported = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] report_interval = 120 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] reservation_clean_interval = 86400 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] reservation_expire = 86400 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] reserved_image_namespaces = [] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] reserved_percentage = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] rpc_response_timeout = 120 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] run_external_periodic_tasks = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] scst_target_driver = iscsi {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] scst_target_iqn_name = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] service_down_time = 720 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] shell_completion = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] snapshot_name_template = snapshot-%s {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] split_loggers = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] state_path = /opt/stack/data/cinder {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] storage_availability_zone = nova {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] storage_protocol = iSCSI {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] syslog_log_facility = LOG_USER {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] target_helper = lioadm {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] target_ip_address = 192.168.122.46 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] target_port = 3260 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] target_protocol = iscsi {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] target_secondary_ip_addresses = [] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] trace_flags = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] transfer_api_class = cinder.transfer.api.API {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] transport_url = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] until_refresh = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] use_chap_auth = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] use_default_quota_class = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] use_journal = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] use_json = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] use_multipath_for_image_xfer = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] use_stderr = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] use_syslog = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] verify_glance_signatures = enabled {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volume_api_class = cinder.volume.api.API {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volume_backend_name = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volume_clear = zero {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volume_clear_ionice = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volume_clear_size = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volume_copy_bps_limit = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volume_dd_blocksize = 1M {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volume_name_template = volume-%s {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volume_service_inithost_offload = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volume_usage_audit_period = month {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] zoning_mode = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_concurrency.disable_process_locking = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.auth_section = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.auth_type = password {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.auth_version = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.cache = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.certfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.delay_auth_decision = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.http_connect_timeout = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.include_service_catalog = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.insecure = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.interface = public {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.keyfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_password = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcache_username = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.region_name = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[86149]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86149) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 13:45:07 devstack cinder-volume[86149]: WARNING cinder.volume.drivers.quobyte [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 13:45:07 devstack cinder-volume[86149]: WARNING cinder.volume.drivers.quobyte [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.service_token_roles_required = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.service_type = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.token_cache_time = 300 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.46/identity {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.backend = dogpile.cache.null {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.backend_argument = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.backend_expiration_time = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.config_prefix = cache.oslo {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[86149]: DEBUG oslo_concurrency.processutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Running cmd (subprocess): mount.quobyte {{(pid=86149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.debug_cache_backend = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.enable_retry_client = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.enable_socket_keepalive = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.enabled = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.expiration_time = 600 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.hashclient_retry_attempts = 2 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.memcache_dead_retry = 300 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.memcache_pool_maxsize = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.memcache_sasl_enabled = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.password = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.proxies = [] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.redis_db = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.redis_sentinel_service_name = mymaster {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.redis_server = localhost:6379 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.retry_attempts = 2 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.retry_delay = 0.0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.socket_keepalive_count = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.socket_keepalive_idle = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.socket_keepalive_interval = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.socket_timeout = 1.0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.tls_allowed_ciphers = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.tls_cafile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.tls_certfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.tls_enabled = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.tls_keyfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cache.username = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] coordination.backend_url = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.asyncio_connection = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.asyncio_slave_connection = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.backend = sqlalchemy {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.connection = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.connection_debug = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.connection_parameters = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.connection_recycle_time = 3600 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.connection_trace = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.db_inc_retry_interval = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.db_max_retries = 20 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.db_max_retry_interval = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.db_retry_interval = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.max_overflow = 50 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.max_pool_size = 5 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.max_retries = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.mysql_wsrep_sync_wait = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.pool_timeout = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.retry_interval = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.slave_connection = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.sqlite_synchronous = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.synchronous_reader = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] database.use_db_reconnect = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler.connection_string = messaging:// {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler.enabled = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler.es_doc_type = notification {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler.es_scroll_size = 10000 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler.es_scroll_time = 2m {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler.filter_error_trace = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler.hmac_keys = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler.sentinel_service_name = mymaster {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler.socket_timeout = 0.1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler.trace_requests = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler.trace_sqlalchemy = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler_jaeger.process_tags = {} {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler_jaeger.service_name_prefix = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] profiler_otlp.service_name_prefix = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_policy.enforce_new_defaults = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_policy.enforce_scope = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_policy.policy_default_rule = default {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_policy.policy_file = policy.yaml {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_policy.remote_timeout = 60.0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] privsep_osbrick.group = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] privsep_osbrick.helper_command = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] privsep_osbrick.user = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cinder_sys_admin.group = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cinder_sys_admin.helper_command = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] cinder_sys_admin.user = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] service_user.auth_section = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] service_user.auth_type = password {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] service_user.cafile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] service_user.certfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] service_user.collect_timing = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] service_user.insecure = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] service_user.keyfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] service_user.send_service_user_token = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] service_user.split_loggers = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] service_user.timeout = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance.auth_section = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance.auth_type = password {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance.certfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance.collect_timing = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance.insecure = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance.keyfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance.region_name = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance.split_loggers = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] glance.timeout = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.backend_availability_zone = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.chap_password = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.chap_username = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.disk_geometry = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.driver_client_cert = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.driver_client_cert_key = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.driver_data_namespace = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.driver_use_ssl = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.enable_unsupported_driver = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.extra_capabilities = {} {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.filter_function = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.goodness_function = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.iscsi_target_flags = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.iscsi_write_cache = on {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.iser_helper = tgtadm {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.iser_ip_address = 192.168.122.46 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.iser_port = 3260 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nas_host = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nas_login = admin {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nas_mount_options = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nas_password = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nas_private_key = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nas_share_path = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nas_ssh_port = 22 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.num_shell_tries = 3 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.nvmet_port_id = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.quobyte_client_cfg = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.quobyte_volume_url = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.replication_device = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.report_discard_supported = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.reserved_percentage = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.scst_target_driver = iscsi {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.scst_target_iqn_name = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.storage_protocol = iSCSI {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.target_helper = tgtadm {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.target_ip_address = 192.168.122.46 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.target_port = 3260 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.target_protocol = iscsi {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.trace_flags = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.unique_fqdn_network = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.use_chap_auth = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.volume_backend_name = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.volume_clear = zero {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.volume_clear_ionice = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.volume_clear_size = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack quobyte-client[86150]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_reports.file_event_handler = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack quobyte-client[86150]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_reports.log_dir = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.backend_availability_zone = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.backend_host = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.chap_password = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.chap_username = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.chiscsi_conf = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.disk_geometry = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.driver_client_cert = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[86149]: DEBUG oslo_concurrency.processutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] CMD "mount.quobyte" returned: 1 in 0.130s {{(pid=86149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.driver_client_cert_key = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.driver_data_namespace = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86149) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86149) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.driver_use_ssl = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.extra_capabilities = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.filter_function = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.goodness_function = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[86149]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86149) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.iscsi_target_flags = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.iscsi_write_cache = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.iser_helper = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.iser_ip_address = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[86149]: INFO cinder.volume.drivers.quobyte [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 ... Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.iser_port = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.iser_target_prefix = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nas_host = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nas_login = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nas_mount_options = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[86149]: DEBUG oslo_concurrency.processutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c -c /etc/quobyte/client-cinder.cfg {{(pid=86149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nas_password = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nas_private_key = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nas_share_path = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nas_ssh_port = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.num_shell_tries = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nvmet_ns_id = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.nvmet_port_id = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.replication_device = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.report_discard_supported = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.reserved_percentage = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.scst_target_driver = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.storage_protocol = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.target_helper = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.target_ip_address = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.target_port = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.target_prefix = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.target_protocol = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.trace_flags = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.unique_fqdn_network = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.use_chap_auth = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.volume_clear = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.volume_clear_ionice = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.volume_clear_size = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] QuobyteHD.volumes_dir = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.ssl = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.ssl_version = {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_notifications.driver = [] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_notifications.retry = -1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] oslo_messaging_notifications.transport_url = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] key_manager.fixed_key = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.barbican_api_version = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.barbican_endpoint = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.barbican_endpoint_type = public {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.barbican_region_name = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.cafile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.certfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.collect_timing = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.insecure = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.keyfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.number_of_retries = 60 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.retry_delay = 1 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.send_service_user_token = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.split_loggers = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.timeout = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.verify_ssl = True {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican.verify_ssl_path = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican_service_user.auth_section = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican_service_user.auth_type = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican_service_user.cafile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican_service_user.certfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican_service_user.collect_timing = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican_service_user.insecure = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican_service_user.keyfile = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican_service_user.split_loggers = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] barbican_service_user.timeout = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] vault.approle_role_id = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] vault.approle_secret_id = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c -c /etc/quobyte/client-cinder.cfg Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] vault.kv_mountpoint = secret {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] vault.kv_path = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] vault.kv_version = 2 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] vault.namespace = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] vault.root_token_id = **** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] vault.ssl_ca_crt_file = None {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] vault.timeout = 60.0 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] vault.use_ssl = False {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:07 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] ******************************************************************************** {{(pid=85935) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 13:45:08 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Jul 03 13:45:08 devstack cinder-volume[86149]: DEBUG oslo_concurrency.processutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.818s {{(pid=86149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:45:08 devstack cinder-volume[86149]: INFO cinder.volume.drivers.quobyte [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 succeeded Jul 03 13:45:08 devstack cinder-volume[86149]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86149) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:45:08 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.834s {{(pid=86149) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:45:08 devstack cinder-volume[86149]: DEBUG oslo_concurrency.processutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:45:08 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:45:08 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:45:09 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG oslo_concurrency.processutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.634s {{(pid=86149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:45:09 devstack cinder-volume[86149]: INFO cinder.volume.driver [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG cinder.volume.driver [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86149) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG oslo_db.sqlalchemy.engines [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86149) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG dbcounter [-] [86149] Writer thread running {{(pid=86149) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG cinder.db.sqlalchemy.api [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Building query based on filter {{(pid=86149) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG cinder.image.image_utils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86149) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 03 13:45:09 devstack cinder-volume[86149]: INFO cinder.keymgr.migration [None req-3d983af4-7995-4d7f-a41d-d140f8c6d43e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86149) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86149) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86149) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86149) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86149) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG oslo_concurrency.processutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:45:09 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:45:09 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:45:09 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG oslo_concurrency.processutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.618s {{(pid=86149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG cinder.manager [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Notifying Schedulers of capabilities ... {{(pid=86149) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:45:09 devstack cinder-volume[86149]: INFO cinder.volume.manager [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Driver initialization completed successfully. Jul 03 13:45:09 devstack cinder-volume[86149]: INFO cinder.manager [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Initiating service 3 cleanup Jul 03 13:45:09 devstack cinder-volume[86149]: INFO cinder.manager [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Service 3 cleanup completed. Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG cinder.service [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Creating RPC server for service cinder-volume {{(pid=86149) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 13:45:09 devstack cinder-volume[86149]: DEBUG cinder.service [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86149) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 13:45:10 devstack cinder-volume[86149]: INFO cinder.volume.manager [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 13:45:10 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86149) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:45:10 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86149) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:45:10 devstack cinder-volume[86149]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86149) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:45:10 devstack cinder-volume[86149]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86149) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:45:10 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86149) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:45:10 devstack cinder-volume[86149]: DEBUG oslo_concurrency.processutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:45:10 devstack sudo[86234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:45:10 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:45:10 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root Jul 03 13:45:10 devstack cinder-volume[86149]: DEBUG oslo_concurrency.processutils [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.780s {{(pid=86149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:45:10 devstack cinder-volume[86149]: INFO cinder.volume.manager [None req-8cb6b951-abfb-4016-bcab-d05fff03a1f2 None None] Driver post RPC initialization completed successfully. Jul 03 13:45:14 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-b4424d8b-2ec1-42c1-b843-f05d802265cf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86149) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:45:14 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-b4424d8b-2ec1-42c1-b843-f05d802265cf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86149) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:45:14 devstack cinder-volume[86149]: DEBUG cinder.volume.drivers.quobyte [None req-b4424d8b-2ec1-42c1-b843-f05d802265cf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86149) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:45:14 devstack cinder-volume[86149]: DEBUG cinder.volume.drivers.quobyte [None req-b4424d8b-2ec1-42c1-b843-f05d802265cf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86149) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:45:14 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-b4424d8b-2ec1-42c1-b843-f05d802265cf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86149) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:45:14 devstack cinder-volume[86149]: DEBUG oslo_concurrency.processutils [None req-b4424d8b-2ec1-42c1-b843-f05d802265cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:45:14 devstack sudo[86347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:45:14 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:45:15 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root Jul 03 13:45:15 devstack cinder-volume[86149]: DEBUG oslo_concurrency.processutils [None req-b4424d8b-2ec1-42c1-b843-f05d802265cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.604s {{(pid=86149) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:45:15 devstack cinder-volume[86149]: DEBUG cinder.manager [None req-b4424d8b-2ec1-42c1-b843-f05d802265cf None None] Notifying Schedulers of capabilities ... {{(pid=86149) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:45:16 devstack cinder-volume[85935]: INFO oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Caught SIGTERM, stopping children Jul 03 13:45:16 devstack cinder-volume[85935]: DEBUG oslo_concurrency.lockutils [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Acquiring lock "singleton_lock" {{(pid=85935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:45:16 devstack cinder-volume[85935]: DEBUG oslo_concurrency.lockutils [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Acquired lock "singleton_lock" {{(pid=85935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:45:16 devstack cinder-volume[85935]: DEBUG oslo_concurrency.lockutils [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Releasing lock "singleton_lock" {{(pid=85935) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:45:16 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Stop services. {{(pid=85935) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 13:45:16 devstack cinder-volume[85935]: DEBUG oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Killing children. {{(pid=85935) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 13:45:16 devstack cinder-volume[85935]: INFO oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Waiting on 1 children to exit Jul 03 13:45:18 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Acquiring lock "singleton_lock" {{(pid=86149) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:45:18 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Acquired lock "singleton_lock" {{(pid=86149) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:45:18 devstack cinder-volume[86149]: DEBUG oslo_concurrency.lockutils [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Releasing lock "singleton_lock" {{(pid=86149) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:45:18 devstack cinder-volume[86149]: WARNING amqp [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 13:45:18 devstack cinder-volume[86149]: WARNING amqp [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 13:45:18 devstack cinder-volume[85935]: INFO oslo_service.backend._eventlet.service [None req-ea4d7648-bdcc-4382-85dd-2d31c0c38c3d None None] Child 86149 exited with status 0 Jul 03 13:45:18 devstack cinder-volume[86461]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 13:45:18 devstack cinder-volume[86461]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 13:45:18 devstack cinder-volume[86461]: we strongly recommend against using it for new projects. Jul 03 13:45:18 devstack cinder-volume[86461]: If you are already using Eventlet, we recommend migrating to a different Jul 03 13:45:18 devstack cinder-volume[86461]: framework. For more detail see Jul 03 13:45:18 devstack cinder-volume[86461]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 13:45:18 devstack cinder-volume[86461]: import eventlet # noqa Jul 03 13:45:21 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 13:45:21 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 13:45:21 devstack cinder-volume[86461]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86461) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 13:45:22 devstack cinder-volume[86461]: INFO dbcounter [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] Registered counter for database cinder Jul 03 13:45:22 devstack cinder-volume[86461]: DEBUG oslo_db.sqlalchemy.engines [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86461) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:45:22 devstack cinder-volume[86461]: DEBUG dbcounter [-] [86461] Writer thread running {{(pid=86461) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 13:45:22 devstack cinder-volume[86461]: INFO cinder.rpc [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 13:45:22 devstack cinder-volume[86461]: INFO cinder.rpc [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 13:45:22 devstack cinder-volume[86461]: DEBUG oslo_db.sqlalchemy.engines [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86461) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:45:22 devstack cinder-volume[86461]: INFO cinder.volume.manager [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] Determined volume DB was empty at startup. Jul 03 13:45:22 devstack cinder-volume[86461]: DEBUG cinder.volume.manager [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86461) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jul 03 13:45:22 devstack cinder-volume[86461]: WARNING stevedore.named [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 13:45:22 devstack cinder-volume[86461]: WARNING castellan.key_manager [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:45:22 devstack cinder-volume[86461]: WARNING cinder.keymgr.conf_key_mgr [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 13:45:22 devstack cinder-volume[86461]: INFO cinder.volume.manager [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_db.sqlalchemy.engines [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86461) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:45:23 devstack cinder-volume[86461]: INFO oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] Starting 1 workers Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] Started child 86729 {{(pid=86461) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] Full set of CONF: {{(pid=86461) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] ******************************************************************************** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] Configuration options gathered from: {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] ================================================================================ {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] allow_availability_zone_fallback = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] allow_compression_on_image_upload = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] allowed_direct_url_schemes = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] api_rate_limit = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] auth_strategy = keystone {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_availability_zone = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_host = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_stats_polling_interval = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backup_api_class = cinder.backup.api.API {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backup_name_template = backup-%s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backup_use_same_host = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backup_use_temp_snapshot = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] chap_password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] chap_username = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cinder_internal_tenant_project_id = 31dfcb70f373444fb507bc0a5433c808 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cinder_internal_tenant_user_id = e37b0603c72242a09cba27f8fd55c05f {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cluster = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] compression_format = gzip {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] compute_api_class = cinder.compute.nova.API {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] config_dir = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] config_source = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] control_exchange = openstack {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] debug = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] default_availability_zone = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] default_group_type = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] default_volume_type = QuobyteHD {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] disk_geometry = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] driver_client_cert = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] driver_client_cert_key = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] driver_data_namespace = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] driver_ssl_cert_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] driver_ssl_cert_verify = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] driver_use_ssl = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] enable_new_services = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] enable_unsupported_driver = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] enabled_backends = ['QuobyteHD'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] enforce_multipath_for_image_xfer = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] filter_function = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance_api_insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance_api_servers = ['http://192.168.122.46/image'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance_api_ssl_compression = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance_ca_certificates_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance_catalog_info = image:glance:publicURL {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance_certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance_keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance_num_retries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance_request_timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] goodness_function = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] graceful_shutdown_timeout = 5 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] group_api_class = cinder.group.api.API {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] host = devstack {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86729]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] image_compress_on_upload = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] image_conversion_address_space_limit = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] image_conversion_cpu_limit = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] image_conversion_disable = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] image_upload_use_cinder_backend = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] image_upload_use_internal_tenant = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] image_volume_cache_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] image_volume_cache_max_count = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] image_volume_cache_max_size_gb = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] init_host_max_objects_retrieval = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] instance_format = [instance: %(uuid)s] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] iscsi_target_flags = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] iscsi_write_cache = on {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] iser_helper = tgtadm {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] iser_ip_address = 192.168.122.46 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] iser_port = 3260 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] log_color = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] log_config_append = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] log_dir = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] log_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] log_options = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] log_rotate_interval = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] log_rotate_interval_type = days {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] log_rotation_type = none {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] max_age = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] max_logfile_count = 30 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] max_logfile_size_mb = 200 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] max_over_subscription_ratio = 20.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] message_reap_interval = 86400 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] message_ttl = 2592000 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] migration_create_volume_timeout_secs = 300 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] monkey_patch = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] monkey_patch_modules = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] my_ip = 192.168.122.46 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] no_snapshot_gb_quota = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] num_iser_scan_tries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] num_shell_tries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] num_volume_device_scan_tries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] nvmeof_conn_info_version = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] nvmet_ns_id = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] nvmet_port_id = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] osapi_max_limit = 1000 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] osapi_volume_ext_list = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] osapi_volume_listen_port = 8776 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] osapi_volume_use_ssl = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] osapi_volume_workers = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] per_volume_size_limit = -1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] periodic_fuzzy_delay = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] periodic_interval = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] public_endpoint = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] publish_errors = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] quota_backup_gigabytes = 1000 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] quota_backups = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] quota_gigabytes = 1000 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] quota_groups = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] quota_snapshots = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] quota_volumes = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] rate_limit_burst = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] rate_limit_except_level = CRITICAL {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] rate_limit_interval = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] reinit_driver_count = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] replication_device = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] report_discard_supported = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] report_interval = 120 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] reservation_clean_interval = 86400 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] reservation_expire = 86400 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] reserved_image_namespaces = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] reserved_percentage = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] rpc_response_timeout = 120 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] run_external_periodic_tasks = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] scst_target_driver = iscsi {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] scst_target_iqn_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] service_down_time = 720 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] shell_completion = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] snapshot_name_template = snapshot-%s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] split_loggers = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] state_path = /opt/stack/data/cinder {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] storage_availability_zone = nova {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] storage_protocol = iSCSI {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] syslog_log_facility = LOG_USER {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] target_helper = lioadm {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] target_ip_address = 192.168.122.46 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] target_port = 3260 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] target_protocol = iscsi {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] target_secondary_ip_addresses = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] trace_flags = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] transport_url = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] until_refresh = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] use_chap_auth = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] use_default_quota_class = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] use_journal = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] use_json = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] use_multipath_for_image_xfer = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] use_stderr = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] use_syslog = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] verify_glance_signatures = enabled {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volume_api_class = cinder.volume.api.API {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volume_backend_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volume_clear = zero {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volume_clear_ionice = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86729) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volume_clear_size = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volume_copy_bps_limit = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volume_dd_blocksize = 1M {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volume_name_template = volume-%s {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volume_service_inithost_offload = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volume_usage_audit_period = month {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] zoning_mode = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_concurrency.disable_process_locking = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.auth_section = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.auth_type = password {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.auth_version = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.cache = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.include_service_catalog = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.interface = public {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_password = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcache_username = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.region_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.service_type = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.46/identity {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.backend = dogpile.cache.null {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.backend_argument = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.backend_expiration_time = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.config_prefix = cache.oslo {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.debug_cache_backend = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.enable_retry_client = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.enable_socket_keepalive = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.expiration_time = 600 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.hashclient_retry_attempts = 2 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.memcache_dead_retry = 300 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.memcache_pool_maxsize = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.memcache_sasl_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.proxies = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.redis_db = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.redis_server = localhost:6379 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.retry_attempts = 2 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.retry_delay = 0.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.socket_keepalive_count = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.socket_keepalive_idle = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.socket_keepalive_interval = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.socket_timeout = 1.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.tls_allowed_ciphers = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.tls_cafile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.tls_certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.tls_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.tls_keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cache.username = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] coordination.backend_url = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.asyncio_connection = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.asyncio_slave_connection = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.backend = sqlalchemy {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.connection = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.connection_debug = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.connection_parameters = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.connection_recycle_time = 3600 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.connection_trace = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.db_inc_retry_interval = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.db_max_retries = 20 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.db_max_retry_interval = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.db_retry_interval = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.max_overflow = 50 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.max_pool_size = 5 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.max_retries = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.mysql_wsrep_sync_wait = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.pool_timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.retry_interval = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.slave_connection = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.sqlite_synchronous = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.synchronous_reader = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] database.use_db_reconnect = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler.connection_string = messaging:// {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler.enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler.es_doc_type = notification {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler.es_scroll_size = 10000 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler.es_scroll_time = 2m {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler.filter_error_trace = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler.hmac_keys = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler.sentinel_service_name = mymaster {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler.socket_timeout = 0.1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler.trace_requests = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler.trace_sqlalchemy = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler_jaeger.process_tags = {} {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler_jaeger.service_name_prefix = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] profiler_otlp.service_name_prefix = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_policy.enforce_new_defaults = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_policy.enforce_scope = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_policy.policy_default_rule = default {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_policy.policy_file = policy.yaml {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] privsep_osbrick.group = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] privsep_osbrick.helper_command = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] privsep_osbrick.user = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cinder_sys_admin.group = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cinder_sys_admin.helper_command = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] cinder_sys_admin.user = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] service_user.auth_section = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] service_user.auth_type = password {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] service_user.cafile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] service_user.certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] service_user.collect_timing = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] service_user.insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] service_user.keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] service_user.send_service_user_token = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] service_user.split_loggers = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] service_user.timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance.auth_section = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance.auth_type = password {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance.certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance.collect_timing = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance.insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance.keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance.region_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance.split_loggers = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] glance.timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.backend_availability_zone = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86729) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 13:45:23 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.quobyte [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.quobyte [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.chap_password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.chap_username = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.disk_geometry = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.driver_client_cert = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.driver_client_cert_key = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.driver_data_namespace = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Running cmd (subprocess): mount.quobyte {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.driver_use_ssl = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.extra_capabilities = {} {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.filter_function = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.goodness_function = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.iscsi_target_flags = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.iscsi_write_cache = on {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.iser_helper = tgtadm {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.iser_ip_address = 192.168.122.46 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.iser_port = 3260 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nas_host = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nas_login = admin {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nas_mount_options = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nas_password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nas_private_key = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nas_share_path = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.num_shell_tries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.quobyte_volume_url = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.replication_device = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.report_discard_supported = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.reserved_percentage = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.target_helper = tgtadm {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.target_ip_address = 192.168.122.46 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.target_port = 3260 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.target_protocol = iscsi {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.trace_flags = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.unique_fqdn_network = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.use_chap_auth = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.volume_backend_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.volume_clear = zero {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.volume_clear_ionice = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.volume_clear_size = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_reports.file_event_handler = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_reports.log_dir = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.backend_availability_zone = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.backend_host = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.chap_password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.chap_username = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.chiscsi_conf = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.disk_geometry = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.driver_client_cert = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.driver_data_namespace = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.driver_use_ssl = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.extra_capabilities = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.filter_function = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.goodness_function = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.iser_helper = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.iser_ip_address = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.iser_port = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.iser_target_prefix = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nas_host = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nas_login = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nas_mount_options = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nas_password = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nas_private_key = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nas_share_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nas_ssh_port = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.num_shell_tries = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.nvmet_port_id = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.replication_device = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.report_discard_supported = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.reserved_percentage = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.scst_target_driver = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.storage_protocol = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.target_helper = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.target_ip_address = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.target_port = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.target_prefix = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.target_protocol = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.trace_flags = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.use_chap_auth = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.volume_clear = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.volume_clear_size = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] QuobyteHD.volumes_dir = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.ssl = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_notifications.driver = [] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_notifications.retry = -1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] key_manager.fixed_key = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.barbican_api_version = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.barbican_endpoint = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.barbican_endpoint_type = public {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.barbican_region_name = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.cafile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.collect_timing = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.number_of_retries = 60 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.retry_delay = 1 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.send_service_user_token = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.split_loggers = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.verify_ssl = True {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican.verify_ssl_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican_service_user.auth_section = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican_service_user.auth_type = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican_service_user.cafile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican_service_user.certfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican_service_user.collect_timing = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican_service_user.insecure = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican_service_user.keyfile = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican_service_user.split_loggers = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] barbican_service_user.timeout = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] vault.approle_role_id = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] vault.approle_secret_id = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] vault.kv_mountpoint = secret {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] vault.kv_path = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] vault.kv_version = 2 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] vault.namespace = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] vault.root_token_id = **** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] vault.ssl_ca_crt_file = None {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] vault.timeout = 60.0 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] vault.use_ssl = False {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 13:45:23 devstack cinder-volume[86461]: DEBUG oslo_service.backend._eventlet.service [None req-9fa108ba-bf3d-4a4d-85bd-a2384030a793 None None] ******************************************************************************** {{(pid=86461) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 13:45:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] CMD "mount.quobyte" returned: 1 in 0.129s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:45:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:45:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:45:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:45:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:45:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:45:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:45:23 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:45:23 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:45:24 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Jul 03 13:45:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.845s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:45:24 devstack cinder-volume[86729]: INFO cinder.volume.driver [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Driver hasn't implemented _init_vendor_properties() Jul 03 13:45:24 devstack cinder-volume[86729]: DEBUG cinder.volume.driver [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86729) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jul 03 13:45:24 devstack cinder-volume[86729]: DEBUG oslo_db.sqlalchemy.engines [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86729) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 13:45:24 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writer thread running {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 13:45:24 devstack cinder-volume[86729]: DEBUG cinder.db.sqlalchemy.api [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Building query based on filter {{(pid=86729) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 03 13:45:24 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86729) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 03 13:45:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:45:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:45:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:45:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:45:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:45:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:45:24 devstack cinder-volume[86729]: INFO cinder.keymgr.migration [None req-4d6d396e-96da-456e-93b7-9831d8d55cac None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 13:45:24 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:45:24 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:45:25 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Jul 03 13:45:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.634s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:45:25 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:45:25 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Driver initialization completed successfully. Jul 03 13:45:25 devstack cinder-volume[86729]: INFO cinder.manager [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Initiating service 3 cleanup Jul 03 13:45:25 devstack cinder-volume[86729]: INFO cinder.manager [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Service 3 cleanup completed. Jul 03 13:45:25 devstack cinder-volume[86729]: DEBUG cinder.service [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Creating RPC server for service cinder-volume {{(pid=86729) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 13:45:25 devstack cinder-volume[86729]: DEBUG cinder.service [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86729) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 13:45:25 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 13:45:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:45:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:45:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:45:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:45:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:45:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:45:25 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:45:25 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:45:25 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Jul 03 13:45:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.644s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:45:25 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6d25699c-ede9-44ed-a706-dc099735e24d None None] Driver post RPC initialization completed successfully. Jul 03 13:45:33 devstack cinder-volume[86461]: DEBUG dbcounter [-] [86461] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86461) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:45:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=3 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:45:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Flow 'volume_create_manager' (937c1dfa-988b-4263-8565-6a681f2a687f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3e2ac3-b6ab-471c-8c1b-9fe514cca4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3e2ac3-b6ab-471c-8c1b-9fe514cca4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-707087094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b93e14c-a16a-4cae-bcab-5612039f7b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea0cd6c02d4e939a075b939bfef0eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:46:23Z,use_quota=True,user_id='791cb02cfe19401aa93ef819043c16d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9a8aba-02dc-4fbb-a17a-733e5561a0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9a8aba-02dc-4fbb-a17a-733e5561a0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10bf228-a2dc-4696-a294-dcec63dd5b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10bf228-a2dc-4696-a294-dcec63dd5b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b93e14c-a16a-4cae-bcab-5612039f7b8c', 'volume_name': 'volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb2a57a-8f29-4055-af5b-a6b7bb68312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb2a57a-8f29-4055-af5b-a6b7bb68312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fbd089-c8b0-44b5-8ca4-35b267f67c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:46:23 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Volume 7b93e14c-a16a-4cae-bcab-5612039f7b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c', 'volume_size': 1} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-707087094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b93e14c-a16a-4cae-bcab-5612039f7b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea0cd6c02d4e939a075b939bfef0eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:46:23Z,use_quota=True,user_id='791cb02cfe19401aa93ef819043c16d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Creating volume 7b93e14c-a16a-4cae-bcab-5612039f7b8c {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:46:23 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:46:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:23 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c 1073741824 Jul 03 13:46:23 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:24 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c 1073741824" returned: 0 in 1.199s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:24 devstack sudo[87489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c Jul 03 13:46:24 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:25 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c" returned: 0 in 0.840s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fbd089-c8b0-44b5-8ca4-35b267f67c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018da10b-857f-4557-a5db-72e0a379a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:46:25 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Volume volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c (7b93e14c-a16a-4cae-bcab-5612039f7b8c): created successfully Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018da10b-857f-4557-a5db-72e0a379a756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Flow 'volume_create_manager' (937c1dfa-988b-4263-8565-6a681f2a687f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:46:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:46:25 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b2335bb8-cb58-4c00-9247-e28779faa2d3 tempest-TaggedAttachmentsTest-1404563566 None] Created volume successfully. Jul 03 13:46:25 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:46:25 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:46:26 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Jul 03 13:46:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.693s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:46:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:46:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:46:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Flow 'volume_create_manager' (6fd95c7d-04ee-4865-9bd3-e4ace36672b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defcdd46-6410-43cb-b89c-0000904f7d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (defcdd46-6410-43cb-b89c-0000904f7d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-46492254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d7e554-d0de-4a8a-9e93-75db6e08c10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8d08bf748945439b536e3779ff985e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:47:05Z,use_quota=True,user_id='b899acb8e40940e2b0bdf7e553f51c1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ae9a24-11bc-40c7-b21c-b2f512a5d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ae9a24-11bc-40c7-b21c-b2f512a5d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e6ecc1-543e-4e49-9eea-4fc20268c1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e6ecc1-543e-4e49-9eea-4fc20268c1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d7e554-d0de-4a8a-9e93-75db6e08c10e', 'volume_name': 'volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2b73aa-05c6-4b1a-b0c9-43fa7175713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2b73aa-05c6-4b1a-b0c9-43fa7175713f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87631757-0ba0-4dbb-b02a-4779750a238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:47:05 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Volume 25d7e554-d0de-4a8a-9e93-75db6e08c10e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e', 'volume_size': 1} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-46492254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d7e554-d0de-4a8a-9e93-75db6e08c10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8d08bf748945439b536e3779ff985e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:47:05Z,use_quota=True,user_id='b899acb8e40940e2b0bdf7e553f51c1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Creating volume 25d7e554-d0de-4a8a-9e93-75db6e08c10e {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:47:05 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:47:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:47:05 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e 1073741824 Jul 03 13:47:05 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:47:07 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Jul 03 13:47:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e 1073741824" returned: 0 in 2.072s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:47:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:47:07 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e Jul 03 13:47:07 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:47:09 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Jul 03 13:47:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e" returned: 0 in 1.568s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:47:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] <== create_volume: return (3744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:47:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.749s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:47:09 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87631757-0ba0-4dbb-b02a-4779750a238c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:47:09 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1994ba4-3d39-4acb-a40a-daae29840240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:47:09 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Volume volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e (25d7e554-d0de-4a8a-9e93-75db6e08c10e): created successfully Jul 03 13:47:09 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1994ba4-3d39-4acb-a40a-daae29840240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:47:09 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Flow 'volume_create_manager' (6fd95c7d-04ee-4865-9bd3-e4ace36672b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:47:09 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-63beb35a-b150-4008-853c-ccd02e19c50d tempest-VolumesAdminNegativeTest-596209861 None] Created volume successfully. Jul 03 13:47:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Acquiring lock "cinder-25d7e554-d0de-4a8a-9e93-75db6e08c10e-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:47:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Lock "cinder-25d7e554-d0de-4a8a-9e93-75db6e08c10e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:47:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Acquiring lock "cinder-quobyte-25d7e554-d0de-4a8a-9e93-75db6e08c10e" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:47:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Lock "cinder-quobyte-25d7e554-d0de-4a8a-9e93-75db6e08c10e" acquired by "delete_volume" :: waited 0.042s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:47:12 devstack cinder-volume[86729]: INFO oslo.privsep.daemon [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyvompcih/privsep.sock'] Jul 03 13:47:12 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyvompcih/privsep.sock Jul 03 13:47:12 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:47:13 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 13:47:13 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 13:47:13 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 13:47:13 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 13:47:13 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 13:47:13 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 13:47:13 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 13:47:13 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 13:47:13 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 13:47:14 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 13:47:14 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 13:47:14 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 13:47:14 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 13:47:14 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 13:47:14 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 13:47:14 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 13:47:14 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 13:47:14 devstack cinder-volume[86729]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 13:47:15 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Jul 03 13:47:15 devstack cinder-volume[86729]: INFO oslo.privsep.daemon [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Spawned new privsep daemon via rootwrap Jul 03 13:47:15 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Accepted privsep connection to /tmp/tmpyvompcih/privsep.sock {{(pid=86729) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 03 13:47:15 devstack cinder-volume[86729]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 03 13:47:15 devstack cinder-volume[86729]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 03 13:47:15 devstack cinder-volume[86729]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 03 13:47:15 devstack cinder-volume[86729]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88039 Jul 03 13:47:15 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c6038d-52d0-4ca0-83ed-b41657bdfb03]: (2,) {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:47:15 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[68887822-2aa9-4166-bdc1-48cf9fa9452e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:47:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:47:15 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e Jul 03 13:47:15 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:47:18 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Jul 03 13:47:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e" returned: 0 in 3.023s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:47:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:47:18 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e Jul 03 13:47:18 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:47:20 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Jul 03 13:47:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-25d7e554-d0de-4a8a-9e93-75db6e08c10e" returned: 0 in 1.971s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:47:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Lock "cinder-quobyte-25d7e554-d0de-4a8a-9e93-75db6e08c10e" released by "delete_volume" :: held 7.658s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:47:20 devstack cinder-volume[86729]: WARNING cinder.quota [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:47:20 devstack cinder-volume[86729]: WARNING cinder.quota [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:47:20 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Created reservations ['5a2ba5a8-2cad-47e4-ac6d-666ae05397bd', 'db43b871-3d59-400b-91fe-1446c68a1a4d', '8083fb68-9a46-4bb9-a789-74471a7f9380', 'd6c3fa5c-0f6d-42c0-bf9f-f75b4b21bb1b'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:47:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:47:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:47:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:47:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:47:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:47:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:47:20 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:47:20 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:47:22 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Jul 03 13:47:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.730s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:47:22 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:47:22 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Deleted volume successfully. Jul 03 13:47:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ca0ba9ca-c69f-43bd-adbd-ed014a3e31d1 tempest-VolumesAdminNegativeTest-596209861 None] Lock "cinder-25d7e554-d0de-4a8a-9e93-75db6e08c10e-delete_volume" released by "delete_volume" :: held 10.404s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Flow 'volume_create_manager' (c877dce1-f458-4eed-8705-c2b58e643695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22d95fc-bd4e-4b1a-a10a-ddc8a2e4fac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22d95fc-bd4e-4b1a-a10a-ddc8a2e4fac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1932891122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7d906a-5aed-4c0e-a691-ea6335f2abf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38fc1457deb41b397c7eb25cdb21d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:47:24Z,use_quota=True,user_id='c88edd2b729a462d9f46b51275304d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be18b6c2-85ba-4051-9317-5a6006dbce0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be18b6c2-85ba-4051-9317-5a6006dbce0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e42fe2-057e-4ca8-9388-be0fce65f121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e42fe2-057e-4ca8-9388-be0fce65f121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d7d906a-5aed-4c0e-a691-ea6335f2abf4', 'volume_name': 'volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b10dbd7-50f3-46c0-8731-a66f45d28c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b10dbd7-50f3-46c0-8731-a66f45d28c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1040f0-3552-4f96-91c6-55f9746bc157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:47:24 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Volume 7d7d906a-5aed-4c0e-a691-ea6335f2abf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4', 'volume_size': 1} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1932891122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7d906a-5aed-4c0e-a691-ea6335f2abf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b38fc1457deb41b397c7eb25cdb21d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:47:24Z,use_quota=True,user_id='c88edd2b729a462d9f46b51275304d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Creating volume 7d7d906a-5aed-4c0e-a691-ea6335f2abf4 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:47:24 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:47:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:47:24 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4 1073741824 Jul 03 13:47:24 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:47:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:47:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:47:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:47:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:47:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:47:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:47:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:47:26 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:47:26 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:47:26 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Jul 03 13:47:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4 1073741824" returned: 0 in 1.898s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:47:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:47:26 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4 Jul 03 13:47:26 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:47:27 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Jul 03 13:47:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.578s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:47:27 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:47:27 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Jul 03 13:47:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4" returned: 0 in 1.268s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:47:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] <== create_volume: return (3263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:47:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.267s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:47:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1040f0-3552-4f96-91c6-55f9746bc157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:47:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d6f2e5-f5c9-4b97-a6a5-31eef66c2dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:47:27 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Volume volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4 (7d7d906a-5aed-4c0e-a691-ea6335f2abf4): created successfully Jul 03 13:47:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d6f2e5-f5c9-4b97-a6a5-31eef66c2dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:47:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Flow 'volume_create_manager' (c877dce1-f458-4eed-8705-c2b58e643695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:47:27 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ce34f99c-4d10-4070-ac8e-87ee0973d530 tempest-ServerRescueNegativeTestJSON-985390962 None] Created volume successfully. Jul 03 13:47:37 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=16,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:47:37 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:47:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Acquiring lock "cinder-7d7d906a-5aed-4c0e-a691-ea6335f2abf4-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:47:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Lock "cinder-7d7d906a-5aed-4c0e-a691-ea6335f2abf4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:47:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Acquiring lock "cinder-quobyte-7d7d906a-5aed-4c0e-a691-ea6335f2abf4" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:47:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Lock "cinder-quobyte-7d7d906a-5aed-4c0e-a691-ea6335f2abf4" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:47:54 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a9d4f3-95f1-4673-a9b3-c6f025c398b5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:47:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:47:54 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4 Jul 03 13:47:54 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:47:56 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Jul 03 13:47:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4" returned: 0 in 1.721s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:47:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:47:56 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4 Jul 03 13:47:56 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:47:58 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Jul 03 13:47:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7d7d906a-5aed-4c0e-a691-ea6335f2abf4" returned: 0 in 2.179s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:47:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Lock "cinder-quobyte-7d7d906a-5aed-4c0e-a691-ea6335f2abf4" released by "delete_volume" :: held 4.002s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:47:58 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Created reservations ['3e7bad0a-31bf-4339-b270-98669bbeefe9', 'c055a825-3412-492c-8660-023b1f5ffc1b', '87056f28-34a9-4c8d-bb55-f219928703f5', '3c31bea5-2848-4b89-83f4-c0c03151f9d9'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:47:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:47:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:47:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:47:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:47:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:47:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:47:58 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:47:58 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:00 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.453s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:00 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:48:00 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Deleted volume successfully. Jul 03 13:48:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-873ccb68-7128-4480-ab4e-9389fb7f3e82 tempest-ServerRescueNegativeTestJSON-985390962 None] Lock "cinder-7d7d906a-5aed-4c0e-a691-ea6335f2abf4-delete_volume" released by "delete_volume" :: held 6.099s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:03 devstack cinder-volume[86729]: WARNING py.warnings [req-cdce3065-1178-4ba6-8fd0-2d3ae9194217 req-59e87d30-871b-4c66-9f0e-4e27117f0d49 tempest-TaggedAttachmentsTest-1404563566 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 03 13:48:03 devstack cinder-volume[86729]: .first() Jul 03 13:48:03 devstack cinder-volume[86729]: Jul 03 13:48:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-cdce3065-1178-4ba6-8fd0-2d3ae9194217 req-59e87d30-871b-4c66-9f0e-4e27117f0d49 tempest-TaggedAttachmentsTest-1404563566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-cdce3065-1178-4ba6-8fd0-2d3ae9194217 req-59e87d30-871b-4c66-9f0e-4e27117f0d49 tempest-TaggedAttachmentsTest-1404563566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:03 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9531cdf-a3e7-4295-a01e-9c85b2c6b279]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:48:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-cdce3065-1178-4ba6-8fd0-2d3ae9194217 req-59e87d30-871b-4c66-9f0e-4e27117f0d49 tempest-TaggedAttachmentsTest-1404563566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:04 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c Jul 03 13:48:04 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:05 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-cdce3065-1178-4ba6-8fd0-2d3ae9194217 req-59e87d30-871b-4c66-9f0e-4e27117f0d49 tempest-TaggedAttachmentsTest-1404563566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c" returned: 0 in 1.145s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-cdce3065-1178-4ba6-8fd0-2d3ae9194217 req-59e87d30-871b-4c66-9f0e-4e27117f0d49 tempest-TaggedAttachmentsTest-1404563566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.189s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-cdce3065-1178-4ba6-8fd0-2d3ae9194217 req-59e87d30-871b-4c66-9f0e-4e27117f0d49 tempest-TaggedAttachmentsTest-1404563566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01373591-394b-4a7f-ad9f-ce7bb6abcb0a', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:48:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-cdce3065-1178-4ba6-8fd0-2d3ae9194217 req-59e87d30-871b-4c66-9f0e-4e27117f0d49 tempest-TaggedAttachmentsTest-1404563566 None] attachment_update completed successfully. Jul 03 13:48:15 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=13,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:48:15 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=11,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:48:15 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-01dc3b57-97c6-4a85-a440-d63104fd5779 req-f13ad47f-7db1-47c1-bd68-e38d5a044406 tempest-TaggedAttachmentsTest-1404563566 None] Terminate volume connection completed successfully. Jul 03 13:48:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-01dc3b57-97c6-4a85-a440-d63104fd5779 req-f13ad47f-7db1-47c1-bd68-e38d5a044406 tempest-TaggedAttachmentsTest-1404563566 None] Deleting attachment 01373591-394b-4a7f-ad9f-ce7bb6abcb0a. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Flow 'volume_create_manager' (102b6e35-e4f4-4cc5-b094-f376bee001e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3fe0a2-e9e7-4afd-95c3-0ca89cf7fb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3fe0a2-e9e7-4afd-95c3-0ca89cf7fb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-338488468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f3f0c8-ee9b-4407-a940-c5ab2bfa5149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2473f103f04d00bd12a19a4887712c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:48:26Z,use_quota=True,user_id='2ed52616cd124b9f8f31ad0af4ff2466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0095215d-4ebc-48fd-88a6-10453c82c405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0095215d-4ebc-48fd-88a6-10453c82c405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc85e715-b2c7-4484-8163-4377a568e4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc85e715-b2c7-4484-8163-4377a568e4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99f3f0c8-ee9b-4407-a940-c5ab2bfa5149', 'volume_name': 'volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ff08bb-c4a8-4e33-bb00-2db9ede89220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ff08bb-c4a8-4e33-bb00-2db9ede89220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400399fe-f3a2-4adb-b55a-bd74797a568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:25 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Volume 99f3f0c8-ee9b-4407-a940-c5ab2bfa5149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149', 'volume_size': 1} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-338488468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f3f0c8-ee9b-4407-a940-c5ab2bfa5149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2473f103f04d00bd12a19a4887712c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:48:26Z,use_quota=True,user_id='2ed52616cd124b9f8f31ad0af4ff2466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Creating volume 99f3f0c8-ee9b-4407-a940-c5ab2bfa5149 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:48:25 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:25 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149 1073741824 Jul 03 13:48:25 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:25 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:48:25 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Flow 'volume_create_manager' (df4da714-1fa9-461d-8da4-45027a6d088a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542b1b9c-621f-43da-81e4-0a531e7aa7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542b1b9c-621f-43da-81e4-0a531e7aa7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2078558190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f19e8d5-cbee-4ff7-9a1e-e1941613e00b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='793b34ea4662465b9deb44c3b04e61c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:48:26Z,use_quota=True,user_id='96885ccc73ca495eafc66b6930884726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b65176-d735-4bc3-869e-9aa0eca83ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b65176-d735-4bc3-869e-9aa0eca83ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a562c566-3743-40d0-a404-d745573636be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a562c566-3743-40d0-a404-d745573636be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f19e8d5-cbee-4ff7-9a1e-e1941613e00b', 'volume_name': 'volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81452e28-1ae5-4077-8b25-f2d0f5cae6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81452e28-1ae5-4077-8b25-f2d0f5cae6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e148b7-4538-4da3-a8ec-954da9d93a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:26 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Volume 0f19e8d5-cbee-4ff7-9a1e-e1941613e00b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b', 'volume_size': 1} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:26 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.850s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:48:26 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149 1073741824" returned: 0 in 1.163s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:26 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149 Jul 03 13:48:26 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:27 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149" returned: 0 in 0.802s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.443s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2078558190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f19e8d5-cbee-4ff7-9a1e-e1941613e00b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='793b34ea4662465b9deb44c3b04e61c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:48:26Z,use_quota=True,user_id='96885ccc73ca495eafc66b6930884726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Creating volume 0f19e8d5-cbee-4ff7-9a1e-e1941613e00b {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:48:27 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:27 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b 1073741824 Jul 03 13:48:27 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400399fe-f3a2-4adb-b55a-bd74797a568d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6357072-62be-43f5-b503-72d1f2ba1431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:27 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Volume volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149 (99f3f0c8-ee9b-4407-a940-c5ab2bfa5149): created successfully Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6357072-62be-43f5-b503-72d1f2ba1431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Flow 'volume_create_manager' (102b6e35-e4f4-4cc5-b094-f376bee001e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:48:27 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-41fd7ce6-b429-42e7-b59d-dcd6f1eaca49 tempest-ServersNegativeTestJSON-698053151 None] Created volume successfully. Jul 03 13:48:28 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b 1073741824" returned: 0 in 1.047s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:28 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b Jul 03 13:48:28 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:29 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b" returned: 0 in 0.976s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:48:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e148b7-4538-4da3-a8ec-954da9d93a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e577358a-6a5c-4204-95d7-d69027ef870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:29 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Volume volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b (0f19e8d5-cbee-4ff7-9a1e-e1941613e00b): created successfully Jul 03 13:48:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e577358a-6a5c-4204-95d7-d69027ef870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Flow 'volume_create_manager' (df4da714-1fa9-461d-8da4-45027a6d088a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:48:29 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6772be7f-3b56-48dc-be5c-81a73c2a0e0b tempest-VolumesTestJSON-1672990238 None] Created volume successfully. Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Flow 'volume_create_manager' (645b3e2b-1574-42d6-a82b-f4aedb56d309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45deee4e-c6d7-4e59-b819-efc8b4b6da2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45deee4e-c6d7-4e59-b819-efc8b4b6da2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-245155708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9e13a4-0e08-443f-990d-a61bfae254e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='793b34ea4662465b9deb44c3b04e61c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:48:31Z,use_quota=True,user_id='96885ccc73ca495eafc66b6930884726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa20223-2db6-4b64-82da-a0594da7af72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa20223-2db6-4b64-82da-a0594da7af72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e84379-e745-4135-92ae-8a0a70943582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e84379-e745-4135-92ae-8a0a70943582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c9e13a4-0e08-443f-990d-a61bfae254e6', 'volume_name': 'volume-8c9e13a4-0e08-443f-990d-a61bfae254e6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d83078b-2b90-44eb-8f22-68ef065b5663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d83078b-2b90-44eb-8f22-68ef065b5663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c03e5b9-cbf0-44b3-a9da-b4b3fac4e428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:31 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Volume 8c9e13a4-0e08-443f-990d-a61bfae254e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c9e13a4-0e08-443f-990d-a61bfae254e6', 'volume_size': 1} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-245155708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9e13a4-0e08-443f-990d-a61bfae254e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='793b34ea4662465b9deb44c3b04e61c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:48:31Z,use_quota=True,user_id='96885ccc73ca495eafc66b6930884726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Creating volume 8c9e13a4-0e08-443f-990d-a61bfae254e6 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:48:31 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8c9e13a4-0e08-443f-990d-a61bfae254e6 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:31 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8c9e13a4-0e08-443f-990d-a61bfae254e6 1073741824 Jul 03 13:48:31 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Flow 'volume_create_manager' (790398cc-4239-4f8d-94e2-2ca9b1136137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522d592b-0dc9-4300-8c7c-5b31d5757f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522d592b-0dc9-4300-8c7c-5b31d5757f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2011864877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662b6676-547a-40fc-8262-14f4dabdb2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2473f103f04d00bd12a19a4887712c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:48:31Z,use_quota=True,user_id='2ed52616cd124b9f8f31ad0af4ff2466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c8e820-0ca1-4db6-8c8a-105ef6d2e51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c8e820-0ca1-4db6-8c8a-105ef6d2e51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1cbe4b3-7bb7-4fcb-9185-b1345258a089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1cbe4b3-7bb7-4fcb-9185-b1345258a089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662b6676-547a-40fc-8262-14f4dabdb2e8', 'volume_name': 'volume-662b6676-547a-40fc-8262-14f4dabdb2e8', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85d7a0d-9ead-4fdd-8190-a82242176cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85d7a0d-9ead-4fdd-8190-a82242176cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a50f1d-8368-4225-8b0a-4864d81055c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:31 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Volume 662b6676-547a-40fc-8262-14f4dabdb2e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662b6676-547a-40fc-8262-14f4dabdb2e8', 'volume_size': 1} Jul 03 13:48:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:32 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8c9e13a4-0e08-443f-990d-a61bfae254e6 1073741824" returned: 0 in 0.926s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8c9e13a4-0e08-443f-990d-a61bfae254e6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:32 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8c9e13a4-0e08-443f-990d-a61bfae254e6 Jul 03 13:48:32 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:33 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8c9e13a4-0e08-443f-990d-a61bfae254e6" returned: 0 in 0.646s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.371s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2011864877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662b6676-547a-40fc-8262-14f4dabdb2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2473f103f04d00bd12a19a4887712c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:48:31Z,use_quota=True,user_id='2ed52616cd124b9f8f31ad0af4ff2466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Creating volume 662b6676-547a-40fc-8262-14f4dabdb2e8 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:48:33 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-662b6676-547a-40fc-8262-14f4dabdb2e8 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:33 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-662b6676-547a-40fc-8262-14f4dabdb2e8 1073741824 Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c03e5b9-cbf0-44b3-a9da-b4b3fac4e428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c9e13a4-0e08-443f-990d-a61bfae254e6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:33 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0af112-9389-44f2-b3c7-560551c30c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:33 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Volume volume-8c9e13a4-0e08-443f-990d-a61bfae254e6 (8c9e13a4-0e08-443f-990d-a61bfae254e6): created successfully Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0af112-9389-44f2-b3c7-560551c30c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Flow 'volume_create_manager' (645b3e2b-1574-42d6-a82b-f4aedb56d309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:48:33 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-dc0473e9-e040-4c60-b48b-9ba0c8973835 tempest-VolumesTestJSON-1672990238 None] Created volume successfully. Jul 03 13:48:34 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-662b6676-547a-40fc-8262-14f4dabdb2e8 1073741824" returned: 0 in 1.227s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-662b6676-547a-40fc-8262-14f4dabdb2e8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:34 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-662b6676-547a-40fc-8262-14f4dabdb2e8 Jul 03 13:48:34 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Flow 'volume_create_manager' (758452cb-f391-4520-be38-0c77dbce6ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704cb217-6cfc-4598-80d5-95b6255b004e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704cb217-6cfc-4598-80d5-95b6255b004e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1413011483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69abf4a1-1fce-4520-a4a8-9cb15255cb38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='793b34ea4662465b9deb44c3b04e61c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:48:34Z,use_quota=True,user_id='96885ccc73ca495eafc66b6930884726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeee1143-2a48-4537-94c9-6c3cd18adf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeee1143-2a48-4537-94c9-6c3cd18adf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480dc819-dd16-41f2-a844-1d2346252bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480dc819-dd16-41f2-a844-1d2346252bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69abf4a1-1fce-4520-a4a8-9cb15255cb38', 'volume_name': 'volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f2e3a0-f788-42ba-bb85-6b1eb3e4f5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f2e3a0-f788-42ba-bb85-6b1eb3e4f5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217a841d-8380-487e-837a-39803922ea65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:34 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Volume 69abf4a1-1fce-4520-a4a8-9cb15255cb38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38', 'volume_size': 1} Jul 03 13:48:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:35 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-662b6676-547a-40fc-8262-14f4dabdb2e8" returned: 0 in 1.055s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] <== create_volume: return (2430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.435s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1413011483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69abf4a1-1fce-4520-a4a8-9cb15255cb38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='793b34ea4662465b9deb44c3b04e61c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:48:34Z,use_quota=True,user_id='96885ccc73ca495eafc66b6930884726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Creating volume 69abf4a1-1fce-4520-a4a8-9cb15255cb38 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:48:35 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a50f1d-8368-4225-8b0a-4864d81055c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662b6676-547a-40fc-8262-14f4dabdb2e8', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:35 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38 1073741824 Jul 03 13:48:35 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20eefed7-064c-41ac-b05e-10a232aff88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:35 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Volume volume-662b6676-547a-40fc-8262-14f4dabdb2e8 (662b6676-547a-40fc-8262-14f4dabdb2e8): created successfully Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20eefed7-064c-41ac-b05e-10a232aff88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:35 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Flow 'volume_create_manager' (790398cc-4239-4f8d-94e2-2ca9b1136137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:48:35 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-95610eff-8ad7-4f7a-bcad-4d686d7747bc tempest-ServersNegativeTestJSON-698053151 None] Created volume successfully. Jul 03 13:48:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Acquiring lock "cinder-662b6676-547a-40fc-8262-14f4dabdb2e8-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:48:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Lock "cinder-662b6676-547a-40fc-8262-14f4dabdb2e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:48:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Acquiring lock "cinder-quobyte-662b6676-547a-40fc-8262-14f4dabdb2e8" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:48:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Lock "cinder-quobyte-662b6676-547a-40fc-8262-14f4dabdb2e8" acquired by "delete_volume" :: waited 0.030s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:48:37 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e2e2ab-afa1-435c-ba45-9d9af475dd7a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:48:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-662b6676-547a-40fc-8262-14f4dabdb2e8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:37 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38 1073741824" returned: 0 in 1.579s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:37 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-662b6676-547a-40fc-8262-14f4dabdb2e8 Jul 03 13:48:37 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:37 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38 Jul 03 13:48:37 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:38 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-662b6676-547a-40fc-8262-14f4dabdb2e8" returned: 0 in 1.417s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-662b6676-547a-40fc-8262-14f4dabdb2e8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:38 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-662b6676-547a-40fc-8262-14f4dabdb2e8 Jul 03 13:48:38 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Acquiring lock "cinder-7b93e14c-a16a-4cae-bcab-5612039f7b8c-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:48:38 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38" returned: 0 in 1.419s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] <== create_volume: return (3280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.287s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Lock "cinder-7b93e14c-a16a-4cae-bcab-5612039f7b8c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217a841d-8380-487e-837a-39803922ea65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb824094-24f9-40c1-9094-15508d651acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:38 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Volume volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38 (69abf4a1-1fce-4520-a4a8-9cb15255cb38): created successfully Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb824094-24f9-40c1-9094-15508d651acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Flow 'volume_create_manager' (758452cb-f391-4520-be38-0c77dbce6ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:48:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-07c1f337-93a8-4bca-ad55-f7b429c1bb76 tempest-VolumesTestJSON-1672990238 None] Created volume successfully. Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Acquiring lock "cinder-quobyte-7b93e14c-a16a-4cae-bcab-5612039f7b8c" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Lock "cinder-quobyte-7b93e14c-a16a-4cae-bcab-5612039f7b8c" acquired by "delete_volume" :: waited 0.029s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cc47a1-2261-49e8-bd42-367eb5c8e1a6]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:48:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:39 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c Jul 03 13:48:39 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:39 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-662b6676-547a-40fc-8262-14f4dabdb2e8" returned: 0 in 0.964s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Lock "cinder-quobyte-662b6676-547a-40fc-8262-14f4dabdb2e8" released by "delete_volume" :: held 2.432s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Created reservations ['bb2995a4-04ba-4d00-aeec-20b1d6f6f00e', '62bd926f-b2f2-4947-b9f8-4f0247d77858', 'f6767811-426e-4b85-a707-0938b7668441', 'a3d04f26-343d-4fe0-b778-1f06e988f74a'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Flow 'volume_create_manager' (a80a504e-9ca5-465c-9cb3-fbefd589a4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b03ee5-84e0-4353-9320-f552b34e9eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b03ee5-84e0-4353-9320-f552b34e9eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-176013413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd28814-991a-4b89-81d9-65f4960c8dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7df0dee0851a40568af428cea648384a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:48:39Z,use_quota=True,user_id='52959706b01f4447bdea2d83fa5e2a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fee11d3-5f4c-49c4-8fc4-88c58398c75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fee11d3-5f4c-49c4-8fc4-88c58398c75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6edc406-6ff5-4f09-8377-a1491debc8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6edc406-6ff5-4f09-8377-a1491debc8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd28814-991a-4b89-81d9-65f4960c8dae', 'volume_name': 'volume-7fd28814-991a-4b89-81d9-65f4960c8dae', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d45713e-7bc7-4c61-9954-3f69fa68f604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d45713e-7bc7-4c61-9954-3f69fa68f604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8218180d-f5e9-48b5-b79a-50c6f1963855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:39 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Volume 7fd28814-991a-4b89-81d9-65f4960c8dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd28814-991a-4b89-81d9-65f4960c8dae', 'volume_size': 1} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-176013413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd28814-991a-4b89-81d9-65f4960c8dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7df0dee0851a40568af428cea648384a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:48:39Z,use_quota=True,user_id='52959706b01f4447bdea2d83fa5e2a74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Creating volume 7fd28814-991a-4b89-81d9-65f4960c8dae {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:48:39 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:39 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae 1073741824 Jul 03 13:48:39 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:39 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:48:39 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:39 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c" returned: 0 in 1.034s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:40 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c Jul 03 13:48:40 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Acquiring lock "cinder-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:48:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Lock "cinder-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:48:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Acquiring lock "cinder-quobyte-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:48:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Lock "cinder-quobyte-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149" acquired by "delete_volume" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:48:40 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0af85d9-6618-4893-85e2-094b700d3496]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:48:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:40 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.995s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:40 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:48:40 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Deleted volume successfully. Jul 03 13:48:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-340c574a-680a-41f4-b361-5c480d7a48c0 tempest-ServersNegativeTestJSON-698053151 None] Lock "cinder-662b6676-547a-40fc-8262-14f4dabdb2e8-delete_volume" released by "delete_volume" :: held 3.873s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:40 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149 Jul 03 13:48:40 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:41 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae 1073741824" returned: 0 in 1.506s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:41 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7b93e14c-a16a-4cae-bcab-5612039f7b8c" returned: 0 in 1.244s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:41 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae Jul 03 13:48:41 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Lock "cinder-quobyte-7b93e14c-a16a-4cae-bcab-5612039f7b8c" released by "delete_volume" :: held 2.337s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Created reservations ['b738988b-f252-4386-80ae-5fca73b9f113', '32ad92b5-df8b-491f-bdbe-d93af293b0d9', '0d341e58-3848-4c2f-84ff-b350683cabdd', '6d24f488-66df-49f6-bb13-e001d693d359'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Acquiring lock "cinder-69abf4a1-1fce-4520-a4a8-9cb15255cb38-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:48:41 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:48:41 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Lock "cinder-69abf4a1-1fce-4520-a4a8-9cb15255cb38-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Acquiring lock "cinder-quobyte-69abf4a1-1fce-4520-a4a8-9cb15255cb38" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Lock "cinder-quobyte-69abf4a1-1fce-4520-a4a8-9cb15255cb38" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1ff95a-4ff1-4519-af66-a897e64312b8]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:48:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:41 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38 Jul 03 13:48:41 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:42 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149" returned: 0 in 1.489s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:42 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149 Jul 03 13:48:42 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:42 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae" returned: 0 in 1.323s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] <== create_volume: return (2898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:48:42 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.901s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.002s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:48:42 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Deleted volume successfully. Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8218180d-f5e9-48b5-b79a-50c6f1963855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd28814-991a-4b89-81d9-65f4960c8dae', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b4eb20-1f5b-4215-a794-eec6eb4c2d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:48:42 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Volume volume-7fd28814-991a-4b89-81d9-65f4960c8dae (7fd28814-991a-4b89-81d9-65f4960c8dae): created successfully Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b4eb20-1f5b-4215-a794-eec6eb4c2d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Flow 'volume_create_manager' (a80a504e-9ca5-465c-9cb3-fbefd589a4d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1f5a5980-42a2-4c18-9e54-3ab0a71b2628 tempest-TaggedAttachmentsTest-1404563566 None] Lock "cinder-7b93e14c-a16a-4cae-bcab-5612039f7b8c-delete_volume" released by "delete_volume" :: held 3.888s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:42 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1f0b571a-d9b7-4407-9532-4625f700be9c tempest-DeleteServersTestJSON-2097869955 None] Created volume successfully. Jul 03 13:48:42 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38" returned: 0 in 1.187s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:42 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38 Jul 03 13:48:42 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:43 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149" returned: 0 in 0.993s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:43 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Lock "cinder-quobyte-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149" released by "delete_volume" :: held 2.557s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:43 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Created reservations ['e8762aae-ce48-4944-8f29-7bd12842cbff', '859d3963-cef2-4ba5-a22a-7fc16b817f2a', '22b00b8c-4ba8-484b-b39d-97a6517f5610', 'a7d77230-d9da-4b8f-bb91-dcf6e77dae2e'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:48:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:43 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:48:43 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:43 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-69abf4a1-1fce-4520-a4a8-9cb15255cb38" returned: 0 in 0.939s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:43 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Lock "cinder-quobyte-69abf4a1-1fce-4520-a4a8-9cb15255cb38" released by "delete_volume" :: held 2.200s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Created reservations ['529c3783-6c44-4392-834d-dae3f4695058', '1a798c55-3d16-44f1-b019-f19befaecc62', '449893ad-ef40-4981-b9d5-de670070b2f9', '94305fb4-b04d-4477-bd2f-933c73d198f7'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:44 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:48:44 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:44 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.079s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:48:44 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Deleted volume successfully. Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1ffe5dca-d56e-4e26-a5c8-019c86bc8b98 tempest-ServersNegativeTestJSON-698053151 None] Lock "cinder-99f3f0c8-ee9b-4407-a940-c5ab2bfa5149-delete_volume" released by "delete_volume" :: held 4.022s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:44 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.810s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:48:44 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Deleted volume successfully. Jul 03 13:48:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2f90bff-2a38-42a3-bbb5-a59610227bcd tempest-VolumesTestJSON-1672990238 None] Lock "cinder-69abf4a1-1fce-4520-a4a8-9cb15255cb38-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Acquiring lock "cinder-8c9e13a4-0e08-443f-990d-a61bfae254e6-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:48:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Lock "cinder-8c9e13a4-0e08-443f-990d-a61bfae254e6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:48:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Acquiring lock "cinder-quobyte-8c9e13a4-0e08-443f-990d-a61bfae254e6" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:48:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Lock "cinder-quobyte-8c9e13a4-0e08-443f-990d-a61bfae254e6" acquired by "delete_volume" :: waited 0.037s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:48:45 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc80435-a944-4ddc-a317-d50223df5727]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:48:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8c9e13a4-0e08-443f-990d-a61bfae254e6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:45 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8c9e13a4-0e08-443f-990d-a61bfae254e6 Jul 03 13:48:45 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:47 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8c9e13a4-0e08-443f-990d-a61bfae254e6" returned: 0 in 2.107s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8c9e13a4-0e08-443f-990d-a61bfae254e6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:47 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8c9e13a4-0e08-443f-990d-a61bfae254e6 Jul 03 13:48:47 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-cadcd6cd-2303-48b1-a6ee-df6941373909 req-b32e2323-b422-45cc-acaf-f532a543894c tempest-DeleteServersTestJSON-2097869955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-cadcd6cd-2303-48b1-a6ee-df6941373909 req-b32e2323-b422-45cc-acaf-f532a543894c tempest-DeleteServersTestJSON-2097869955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5888cb77-a585-4213-a3a1-88c5ea2964e4]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:48:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-cadcd6cd-2303-48b1-a6ee-df6941373909 req-b32e2323-b422-45cc-acaf-f532a543894c tempest-DeleteServersTestJSON-2097869955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:47 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae Jul 03 13:48:47 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:48 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8c9e13a4-0e08-443f-990d-a61bfae254e6" returned: 0 in 1.548s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Lock "cinder-quobyte-8c9e13a4-0e08-443f-990d-a61bfae254e6" released by "delete_volume" :: held 3.703s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:48 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-cadcd6cd-2303-48b1-a6ee-df6941373909 req-b32e2323-b422-45cc-acaf-f532a543894c tempest-DeleteServersTestJSON-2097869955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae" returned: 0 in 1.350s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-cadcd6cd-2303-48b1-a6ee-df6941373909 req-b32e2323-b422-45cc-acaf-f532a543894c tempest-DeleteServersTestJSON-2097869955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.383s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-cadcd6cd-2303-48b1-a6ee-df6941373909 req-b32e2323-b422-45cc-acaf-f532a543894c tempest-DeleteServersTestJSON-2097869955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-7fd28814-991a-4b89-81d9-65f4960c8dae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ac3f6d4-51e8-4a55-b1a8-0bc23157d061', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Created reservations ['c030ba75-9656-498f-b467-b46b0db88175', 'f1d0ad6e-231b-464f-96d6-1df1d88b45c3', 'ed27ebdd-fa6f-4fb1-bd05-d164b06cd98a', '06af9834-d3f5-4ae4-b5e1-57cc2715bca8'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:48:49 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-cadcd6cd-2303-48b1-a6ee-df6941373909 req-b32e2323-b422-45cc-acaf-f532a543894c tempest-DeleteServersTestJSON-2097869955 None] attachment_update completed successfully. Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:49 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:48:49 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Acquiring lock "cinder-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Lock "cinder-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Acquiring lock "cinder-quobyte-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Lock "cinder-quobyte-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dfa751-7575-4eb8-9e58-35f8717c219c]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:48:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:50 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.872s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:50 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:48:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Deleted volume successfully. Jul 03 13:48:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b3597df8-4d71-4b20-9890-2ae325053dbf tempest-VolumesTestJSON-1672990238 None] Lock "cinder-8c9e13a4-0e08-443f-990d-a61bfae254e6-delete_volume" released by "delete_volume" :: held 4.912s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:50 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b Jul 03 13:48:50 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:50 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b" returned: 0 in 0.868s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:50 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b Jul 03 13:48:50 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:51 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b" returned: 0 in 0.759s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Lock "cinder-quobyte-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b" released by "delete_volume" :: held 1.679s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:51 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Created reservations ['c902a6b4-5142-441a-b3ca-8785c2800e0d', 'd8bbfe89-6556-4a34-8774-dc17cd040687', '3476d6d7-8958-4f2f-9c56-12f744aa25ec', 'bdc4480a-f3e0-4859-93c8-8ca5ec81867f'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:48:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:48:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:48:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:48:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:48:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:48:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:48:51 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:48:51 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:48:52 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Jul 03 13:48:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.826s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:48:52 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:48:52 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Deleted volume successfully. Jul 03 13:48:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03bcd4ac-9947-4646-afe9-9e07837931e8 tempest-VolumesTestJSON-1672990238 None] Lock "cinder-0f19e8d5-cbee-4ff7-9a1e-e1941613e00b-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:48:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-6ab73030-3ac4-48e7-b30b-b629d2aa70d6 req-320588ea-5073-4b50-abe9-86b40605dcee tempest-DeleteServersTestJSON-2097869955 None] Terminate volume connection completed successfully. Jul 03 13:48:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-6ab73030-3ac4-48e7-b30b-b629d2aa70d6 req-320588ea-5073-4b50-abe9-86b40605dcee tempest-DeleteServersTestJSON-2097869955 None] Deleting attachment 4ac3f6d4-51e8-4a55-b1a8-0bc23157d061. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Flow 'volume_create_manager' (1d4f7afc-4075-4bcf-a105-0c43843fda35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f9563b-79d5-432d-83a5-48dc614a27a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f9563b-79d5-432d-83a5-48dc614a27a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-8632757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb58351-e16a-40e8-9856-38af1d7f8c17,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e7d23f95c59f435e8fc32686e8a0874b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:49:02Z,use_quota=True,user_id='ac205393044849f6aa7ed28ff0f016ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e72ccc-b2aa-4103-a77a-cd79157cfcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e72ccc-b2aa-4103-a77a-cd79157cfcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e218888-5e2e-4667-94cd-1ba269dee78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e218888-5e2e-4667-94cd-1ba269dee78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb58351-e16a-40e8-9856-38af1d7f8c17', 'volume_name': 'volume-aeb58351-e16a-40e8-9856-38af1d7f8c17', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306426a2-b77c-4486-acac-9b41089c20c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306426a2-b77c-4486-acac-9b41089c20c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8285a093-d50d-4099-b167-73dc19481415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:01 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Volume aeb58351-e16a-40e8-9856-38af1d7f8c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb58351-e16a-40e8-9856-38af1d7f8c17', 'volume_size': 1} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-8632757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb58351-e16a-40e8-9856-38af1d7f8c17,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e7d23f95c59f435e8fc32686e8a0874b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:49:02Z,use_quota=True,user_id='ac205393044849f6aa7ed28ff0f016ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Creating volume aeb58351-e16a-40e8-9856-38af1d7f8c17 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:49:01 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:49:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aeb58351-e16a-40e8-9856-38af1d7f8c17 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:01 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aeb58351-e16a-40e8-9856-38af1d7f8c17 1073741824 Jul 03 13:49:01 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:02 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aeb58351-e16a-40e8-9856-38af1d7f8c17 1073741824" returned: 0 in 1.096s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aeb58351-e16a-40e8-9856-38af1d7f8c17 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:02 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aeb58351-e16a-40e8-9856-38af1d7f8c17 Jul 03 13:49:02 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Acquiring lock "cinder-7fd28814-991a-4b89-81d9-65f4960c8dae-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:49:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Lock "cinder-7fd28814-991a-4b89-81d9-65f4960c8dae-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Acquiring lock "cinder-quobyte-7fd28814-991a-4b89-81d9-65f4960c8dae" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Lock "cinder-quobyte-7fd28814-991a-4b89-81d9-65f4960c8dae" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed96ad7-aee1-4531-af0b-7dc838faf352]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:03 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae Jul 03 13:49:03 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:03 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aeb58351-e16a-40e8-9856-38af1d7f8c17" returned: 0 in 0.847s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8285a093-d50d-4099-b167-73dc19481415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb58351-e16a-40e8-9856-38af1d7f8c17', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2663be-4feb-426e-8e28-a18985a23402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:03 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Volume volume-aeb58351-e16a-40e8-9856-38af1d7f8c17 (aeb58351-e16a-40e8-9856-38af1d7f8c17): created successfully Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2663be-4feb-426e-8e28-a18985a23402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Flow 'volume_create_manager' (1d4f7afc-4075-4bcf-a105-0c43843fda35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:49:03 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-f2d96e05-9932-4ec8-aded-8f0ddc433e70 req-401bd00a-675b-48a2-9c6d-c23f6d6ac01a tempest-VolumesGetTestJSON-1366887703 None] Created volume successfully. Jul 03 13:49:03 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae" returned: 0 in 0.915s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:04 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae Jul 03 13:49:04 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:04 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ea0015c2-37d0-4dee-bd88-432568a46b06 tempest-GroupsV320Test-736126131 None] Group tempest-GroupsV320Test-Group-697894683: creating Jul 03 13:49:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fd28814-991a-4b89-81d9-65f4960c8dae" returned: 0 in 0.890s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Lock "cinder-quobyte-7fd28814-991a-4b89-81d9-65f4960c8dae" released by "delete_volume" :: held 1.877s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:49:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ea0015c2-37d0-4dee-bd88-432568a46b06 tempest-GroupsV320Test-736126131 None] Group tempest-GroupsV320Test-Group-697894683: created successfully Jul 03 13:49:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ea0015c2-37d0-4dee-bd88-432568a46b06 tempest-GroupsV320Test-736126131 None] Create group completed successfully. Jul 03 13:49:04 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Created reservations ['8eeecf82-8ae3-4206-82c9-df8dadcabe69', 'd117f6b2-c97d-4f7e-9fe9-bad637932ef2', '2ca7d67d-2a8c-41ed-85fe-cbdac411b532', 'b7351fd4-8955-4e21-9a49-4eb2aa41166d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:05 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:49:05 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Acquiring lock "cinder-aeb58351-e16a-40e8-9856-38af1d7f8c17-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Lock "cinder-aeb58351-e16a-40e8-9856-38af1d7f8c17-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Acquiring lock "cinder-quobyte-aeb58351-e16a-40e8-9856-38af1d7f8c17" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Lock "cinder-quobyte-aeb58351-e16a-40e8-9856-38af1d7f8c17" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[733a75ad-1804-414e-84cc-05e7342341b0]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aeb58351-e16a-40e8-9856-38af1d7f8c17 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:05 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aeb58351-e16a-40e8-9856-38af1d7f8c17 Jul 03 13:49:05 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:05 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.815s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:49:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Deleted volume successfully. Jul 03 13:49:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1d0e99d2-d207-4cca-8ccc-61f74c6288a6 tempest-DeleteServersTestJSON-2097869955 None] Lock "cinder-7fd28814-991a-4b89-81d9-65f4960c8dae-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:49:06 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aeb58351-e16a-40e8-9856-38af1d7f8c17" returned: 0 in 1.207s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aeb58351-e16a-40e8-9856-38af1d7f8c17 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:06 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aeb58351-e16a-40e8-9856-38af1d7f8c17 Jul 03 13:49:06 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:06 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-f1b289b0-280c-48dc-bd20-8820631dc34e tempest-GroupsV320Test-736126131 None] Created reservations ['a0d1789d-1a54-4609-9c68-b32cddf7f046'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:49:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f1b289b0-280c-48dc-bd20-8820631dc34e tempest-GroupsV320Test-736126131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f1b289b0-280c-48dc-bd20-8820631dc34e tempest-GroupsV320Test-736126131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f1b289b0-280c-48dc-bd20-8820631dc34e tempest-GroupsV320Test-736126131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f1b289b0-280c-48dc-bd20-8820631dc34e tempest-GroupsV320Test-736126131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f1b289b0-280c-48dc-bd20-8820631dc34e tempest-GroupsV320Test-736126131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f1b289b0-280c-48dc-bd20-8820631dc34e tempest-GroupsV320Test-736126131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:07 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:49:07 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:07 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aeb58351-e16a-40e8-9856-38af1d7f8c17" returned: 0 in 0.977s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Lock "cinder-quobyte-aeb58351-e16a-40e8-9856-38af1d7f8c17" released by "delete_volume" :: held 2.253s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:49:07 devstack cinder-volume[86729]: DEBUG cinder.quota [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Created reservations ['0f1f13fa-52c4-48ce-b765-8b1c73ab36f3', '6ccc0230-d1d7-4f34-abbd-2f5665441216', '7437515c-1d15-4e0b-95e2-21616d9c4f4e', 'bf63b234-2120-43e8-a5b1-bd06efb02147'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:49:07 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f1b289b0-280c-48dc-bd20-8820631dc34e tempest-GroupsV320Test-736126131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.879s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:07 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-f1b289b0-280c-48dc-bd20-8820631dc34e tempest-GroupsV320Test-736126131 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:49:07 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f1b289b0-280c-48dc-bd20-8820631dc34e tempest-GroupsV320Test-736126131 None] Delete group completed successfully. Jul 03 13:49:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:07 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:49:07 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:08 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.996s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:08 devstack cinder-volume[86729]: DEBUG cinder.manager [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:49:08 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Deleted volume successfully. Jul 03 13:49:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-76d25a23-5f7d-46ca-9949-8c1de8e13e46 req-cf083fa9-c737-4e24-b5d5-6ef9da086692 tempest-VolumesGetTestJSON-1366887703 None] Lock "cinder-aeb58351-e16a-40e8-9856-38af1d7f8c17-delete_volume" released by "delete_volume" :: held 3.575s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:49:17 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=70,cinder:UPDATE=87,cinder:INSERT=17,cinder:DELETE=8 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:49:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e74d3552-67f9-4c33-989d-5e968e7dbd73 tempest-GroupSnapshotsTest-207098367 None] Group tempest-GroupSnapshotsTest-Group-956411484: creating Jul 03 13:49:17 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=68,cinder:UPDATE=93,cinder:DELETE=7,cinder:INSERT=23 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:49:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e74d3552-67f9-4c33-989d-5e968e7dbd73 tempest-GroupSnapshotsTest-207098367 None] Group tempest-GroupSnapshotsTest-Group-956411484: created successfully Jul 03 13:49:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e74d3552-67f9-4c33-989d-5e968e7dbd73 tempest-GroupSnapshotsTest-207098367 None] Create group completed successfully. Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Flow 'volume_create_manager' (0938466e-7d5c-47a2-b921-8493f55da782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d8dcf5-330e-496d-a596-e83d2baa7e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d8dcf5-330e-496d-a596-e83d2baa7e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-856435794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9571ebd6-ff05-4f06-82f0-85270c3b2f26,host='devstack@QuobyteHD#QuobyteHD',id=90732780-ad3a-4c68-a955-75803db8219b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad14972439c4d80b9d0261557eca29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:49:19Z,use_quota=True,user_id='70e61123d10242b7b35342bb81f001d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7890d068-cdcd-4677-bc6a-e47a68ecdbeb),volume_type_id=7890d068-cdcd-4677-bc6a-e47a68ecdbeb)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d64b7df-1aa7-45a3-983e-8c2d869f8495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d64b7df-1aa7-45a3-983e-8c2d869f8495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (315426bd-c6ce-4f36-b54c-c5e5f7da846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (315426bd-c6ce-4f36-b54c-c5e5f7da846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90732780-ad3a-4c68-a955-75803db8219b', 'volume_name': 'volume-90732780-ad3a-4c68-a955-75803db8219b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c87527-730f-46e1-b918-797202357de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c87527-730f-46e1-b918-797202357de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a93bef8-0ed7-4025-837e-e9ac04bce165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:19 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Volume 90732780-ad3a-4c68-a955-75803db8219b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90732780-ad3a-4c68-a955-75803db8219b', 'volume_size': 1} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9571ebd6-ff05-4f06-82f0-85270c3b2f26,created_at=2026-07-03T11:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-856435794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9571ebd6-ff05-4f06-82f0-85270c3b2f26,host='devstack@QuobyteHD#QuobyteHD',id=90732780-ad3a-4c68-a955-75803db8219b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad14972439c4d80b9d0261557eca29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:49:19Z,use_quota=True,user_id='70e61123d10242b7b35342bb81f001d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7890d068-cdcd-4677-bc6a-e47a68ecdbeb),volume_type_id=7890d068-cdcd-4677-bc6a-e47a68ecdbeb)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Creating volume 90732780-ad3a-4c68-a955-75803db8219b {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:49:19 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:49:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:19 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b 1073741824 Jul 03 13:49:19 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:20 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b 1073741824" returned: 0 in 0.999s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:20 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b Jul 03 13:49:20 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:21 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b" returned: 0 in 0.720s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:49:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a93bef8-0ed7-4025-837e-e9ac04bce165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90732780-ad3a-4c68-a955-75803db8219b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dc7ad3-d8c5-4289-bb5a-e258694bfb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:21 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Volume volume-90732780-ad3a-4c68-a955-75803db8219b (90732780-ad3a-4c68-a955-75803db8219b): created successfully Jul 03 13:49:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dc7ad3-d8c5-4289-bb5a-e258694bfb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Flow 'volume_create_manager' (0938466e-7d5c-47a2-b921-8493f55da782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:49:21 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-eccb4f23-5573-4960-8739-0256b64d2aa6 tempest-GroupSnapshotsTest-207098367 None] Created volume successfully. Jul 03 13:49:22 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] GroupSnapshot 19850951-d1d6-44d0-abea-5e8bf2a7be14: creating. Jul 03 13:49:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] Group snapshot 19850951-d1d6-44d0-abea-5e8bf2a7be14: creating. {{(pid=86729) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 13:49:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] Creating offline snapshot 64b3a5d6-9443-4f8c-ace5-df2069c155ef of volume 90732780-ad3a-4c68-a955-75803db8219b {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:49:22 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[73365cd2-a8c3-4743-8c9b-0a0983d60d69]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:49:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:22 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b Jul 03 13:49:22 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:23 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b" returned: 0 in 1.015s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:23 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef 1G Jul 03 13:49:23 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:24 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef 1G" returned: 0 in 1.023s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90732780-ad3a-4c68-a955-75803db8219b -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:24 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90732780-ad3a-4c68-a955-75803db8219b -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef Jul 03 13:49:24 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:25 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90732780-ad3a-4c68-a955-75803db8219b -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef" returned: 0 in 0.941s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:25 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:49:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:25 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef Jul 03 13:49:25 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:26 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef" returned: 0 in 0.839s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:26 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.info Jul 03 13:49:26 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:27 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.info" returned: 0 in 0.800s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:27 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:49:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:27 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.info Jul 03 13:49:27 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:28 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.info" returned: 0 in 1.009s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.743s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:28 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6ca33b1e-326d-445c-ad3c-fdf407b1d2e7 tempest-GroupSnapshotsTest-207098367 None] group_snapshot 19850951-d1d6-44d0-abea-5e8bf2a7be14: created successfully Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-64b3a5d6-9443-4f8c-ace5-df2069c155ef-33c02862-a2bf-4505-8986-da19a3d24c7b" by "_create_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-64b3a5d6-9443-4f8c-ace5-df2069c155ef-33c02862-a2bf-4505-8986-da19a3d24c7b" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Creating volume 33c02862-a2bf-4505-8986-da19a3d24c7b from snapshot 64b3a5d6-9443-4f8c-ace5-df2069c155ef {{(pid=86729) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-33c02862-a2bf-4505-8986-da19a3d24c7b" by "_copy_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-33c02862-a2bf-4505-8986-da19a3d24c7b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] snapshot: 64b3a5d6-9443-4f8c-ace5-df2069c155ef, volume: 33c02862-a2bf-4505-8986-da19a3d24c7b, {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f9f110-cf51-4055-9727-bb717aaf2764]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:49:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:30 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef Jul 03 13:49:30 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Flow 'volume_create_manager' (50debe3a-1b70-4654-8ab3-b95f46fe5286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f29b0b-4c8e-417b-b245-b5d0a550f6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f29b0b-4c8e-417b-b245-b5d0a550f6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-608770852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26711431-04d0-496d-96b0-81828105b04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4720978ae645f989b129ee754dec64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:49:32Z,use_quota=True,user_id='796c6efb77244d7294c2725639ff04d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61be6c0-6da0-439a-9c02-582812237794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61be6c0-6da0-439a-9c02-582812237794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4b3bbe-b106-4c17-ae89-6fb8e80d4807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:31 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4b3bbe-b106-4c17-ae89-6fb8e80d4807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26711431-04d0-496d-96b0-81828105b04d', 'volume_name': 'volume-26711431-04d0-496d-96b0-81828105b04d', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03817065-b2c1-437d-b99f-837c08c2d69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03817065-b2c1-437d-b99f-837c08c2d69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd944a49-641e-45b6-b562-967d8567bca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:31 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Volume 26711431-04d0-496d-96b0-81828105b04d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26711431-04d0-496d-96b0-81828105b04d', 'volume_size': 1} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef" returned: 0 in 1.410s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90732780-ad3a-4c68-a955-75803db8219b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] will copy from snapshot at /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Creating direct copy from snapshot {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9357b0-f17c-448c-9356-b60b45a8231e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:49:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:32 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b Jul 03 13:49:32 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:33 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b" returned: 0 in 1.256s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:33 devstack cinder-volume[86729]: DEBUG cinder.utils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Path /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b not found in is_blk_device check {{(pid=86729) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:49:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:33 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b Jul 03 13:49:33 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:40 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:INSERT=2 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:49:41 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b" returned: 0 in 8.120s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:41 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c6420e-3317-4bc5-8fba-0216abb1f718]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:49:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:41 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b Jul 03 13:49:41 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:41 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=9,cinder:SELECT=16,cinder:DELETE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:49:42 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b" returned: 0 in 1.220s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:42 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b, size 1024.00 MB, duration 8.12 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:49:42 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Converted 1024.00 MB image at 126.08 MB/s Jul 03 13:49:42 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:49:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:42 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b Jul 03 13:49:42 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:43 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b" returned: 0 in 0.669s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-33c02862-a2bf-4505-8986-da19a3d24c7b" released by "_copy_volume_from_snapshot" :: held 12.842s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-64b3a5d6-9443-4f8c-ace5-df2069c155ef-33c02862-a2bf-4505-8986-da19a3d24c7b" released by "_create_volume_from_snapshot" :: held 12.883s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.905s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.372s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-608770852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26711431-04d0-496d-96b0-81828105b04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4720978ae645f989b129ee754dec64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:49:32Z,use_quota=True,user_id='796c6efb77244d7294c2725639ff04d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Creating volume 26711431-04d0-496d-96b0-81828105b04d {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:49:43 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:49:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-26711431-04d0-496d-96b0-81828105b04d 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:43 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-26711431-04d0-496d-96b0-81828105b04d 1073741824 Jul 03 13:49:43 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:43 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e83ee320-fe70-4a12-96ae-3851e5290684 tempest-GroupSnapshotsTest-207098367 None] Create group from source-snapshot-19850951-d1d6-44d0-abea-5e8bf2a7be14 completed successfully. Jul 03 13:49:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-33c02862-a2bf-4505-8986-da19a3d24c7b" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:49:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-33c02862-a2bf-4505-8986-da19a3d24c7b" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:49:44 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf64605-56d0-4766-b757-4d6e80748289]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:49:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:44 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b Jul 03 13:49:44 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:44 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-26711431-04d0-496d-96b0-81828105b04d 1073741824" returned: 0 in 1.125s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-26711431-04d0-496d-96b0-81828105b04d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:44 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-26711431-04d0-496d-96b0-81828105b04d Jul 03 13:49:44 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:45 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b" returned: 0 in 0.947s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:45 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b Jul 03 13:49:45 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:45 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-26711431-04d0-496d-96b0-81828105b04d" returned: 0 in 0.792s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd944a49-641e-45b6-b562-967d8567bca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26711431-04d0-496d-96b0-81828105b04d', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c579b5-6847-4dfc-b645-3c0204775980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:45 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Volume volume-26711431-04d0-496d-96b0-81828105b04d (26711431-04d0-496d-96b0-81828105b04d): created successfully Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c579b5-6847-4dfc-b645-3c0204775980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Flow 'volume_create_manager' (50debe3a-1b70-4654-8ab3-b95f46fe5286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:49:45 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-894eb525-92ee-4d46-84a3-13b30387a3e4 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Created volume successfully. Jul 03 13:49:45 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-33c02862-a2bf-4505-8986-da19a3d24c7b" returned: 0 in 0.688s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-33c02862-a2bf-4505-8986-da19a3d24c7b" released by "delete_volume" :: held 1.678s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Created reservations ['d67fc5cb-b82c-469e-9902-0e154702dbe6'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:49:45 devstack cinder-volume[86729]: WARNING cinder.quota [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-565781178 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-565781178, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:49:45 devstack cinder-volume[86729]: WARNING cinder.quota [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-565781178 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-565781178, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:49:45 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Created reservations ['15944caf-3443-4020-a914-49f7fbbe312b', '2a33d4d0-7d49-4488-b3b1-8436a7a9018b', '8e070c60-ceb3-4e79-9a96-40c8473908bf', '28bd1406-dcf5-420e-ad52-94a4c02ba22b'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:46 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:49:46 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:46 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] group_snapshot 19850951-d1d6-44d0-abea-5e8bf2a7be14: deleting Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] group_snapshot 19850951-d1d6-44d0-abea-5e8bf2a7be14: deleting {{(pid=86729) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-90732780-ad3a-4c68-a955-75803db8219b" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-90732780-ad3a-4c68-a955-75803db8219b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-64b3a5d6-9443-4f8c-ace5-df2069c155ef" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-64b3a5d6-9443-4f8c-ace5-df2069c155ef" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Deleting offline snapshot 64b3a5d6-9443-4f8c-ace5-df2069c155ef of volume 90732780-ad3a-4c68-a955-75803db8219b {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] snapshot_file for this snap is: volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee06b15e-5f51-4f6a-a16c-80607f2caf98]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Acquiring lock "cinder-26711431-04d0-496d-96b0-81828105b04d-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Lock "cinder-26711431-04d0-496d-96b0-81828105b04d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Acquiring lock "cinder-quobyte-26711431-04d0-496d-96b0-81828105b04d" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Lock "cinder-quobyte-26711431-04d0-496d-96b0-81828105b04d" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:49:46 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef Jul 03 13:49:46 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[54aae4d4-a454-45fa-8aea-cd8300e671a8]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:49:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-26711431-04d0-496d-96b0-81828105b04d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:47 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.079s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:47 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:49:47 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-333158bc-b1b8-49ad-bca8-182d4d477701 tempest-GroupSnapshotsTest-207098367 None] Delete group completed successfully. Jul 03 13:49:47 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-26711431-04d0-496d-96b0-81828105b04d Jul 03 13:49:47 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:47 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef" returned: 0 in 0.982s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90732780-ad3a-4c68-a955-75803db8219b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:49:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca838d9-c4b7-4b2d-a7ae-6b3c64a7e600]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:49:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:47 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b Jul 03 13:49:47 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:47 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-26711431-04d0-496d-96b0-81828105b04d" returned: 0 in 1.010s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-26711431-04d0-496d-96b0-81828105b04d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:48 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-26711431-04d0-496d-96b0-81828105b04d Jul 03 13:49:48 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:48 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b" returned: 0 in 0.968s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:48 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-26711431-04d0-496d-96b0-81828105b04d" returned: 0 in 0.742s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:48 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef Jul 03 13:49:48 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Lock "cinder-quobyte-26711431-04d0-496d-96b0-81828105b04d" released by "delete_volume" :: held 1.839s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:49:48 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Created reservations ['1d88d749-738b-4725-ac25-ffb1098411e3', '68f764ad-d6b8-466a-8a1f-be85f60cf803', '86def32a-fbdd-4112-b9a5-46c4426d0f7a', '2179583f-e51b-4c44-9cac-7ca355884dd1'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:49:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:48 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:49:48 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:49 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef" returned: 0 in 0.778s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:49 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef Jul 03 13:49:49 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:49 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.724s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:49 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:49:49 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Deleted volume successfully. Jul 03 13:49:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c76d4474-31af-4032-8e8f-f223066d7c53 tempest-VolumeQuotasNegativeTestJSON-284137228 None] Lock "cinder-26711431-04d0-496d-96b0-81828105b04d-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:49:50 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b.64b3a5d6-9443-4f8c-ace5-df2069c155ef" returned: 0 in 0.675s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-64b3a5d6-9443-4f8c-ace5-df2069c155ef" released by "_delete_snapshot" :: held 3.526s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:49:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-90732780-ad3a-4c68-a955-75803db8219b" released by "delete_snapshot" :: held 3.556s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:49:50 devstack cinder-volume[86729]: WARNING cinder.quota [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-565781178 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-565781178, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:49:50 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] Created reservations ['40365834-4125-4b79-a513-366e1e7f4f61', '6b2c1615-f148-497f-8ba5-736e7c7be86a', 'b699a7d7-99f7-4e81-bc8f-9f21d4e2ecc9', 'baa522d7-ae2c-431f-9d18-ec8cd624a415'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:49:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7db55bc6-0bf8-42d6-8e88-679e0eae20f8 tempest-GroupSnapshotsTest-207098367 None] group_snapshot 19850951-d1d6-44d0-abea-5e8bf2a7be14: deleted successfully Jul 03 13:49:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-90732780-ad3a-4c68-a955-75803db8219b" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:49:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-90732780-ad3a-4c68-a955-75803db8219b" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:49:51 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f59d678-e4f8-4e7b-9af0-b8def5ab66dc]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:49:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:52 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b Jul 03 13:49:52 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:52 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b" returned: 0 in 1.027s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:52 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b Jul 03 13:49:52 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:53 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90732780-ad3a-4c68-a955-75803db8219b" returned: 0 in 0.794s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-90732780-ad3a-4c68-a955-75803db8219b" released by "delete_volume" :: held 1.966s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:49:53 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Created reservations ['ce352368-7c20-4035-89c3-4726ce5a3405'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:49:53 devstack cinder-volume[86729]: WARNING cinder.db.sqlalchemy.api [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-565781178'] Jul 03 13:49:53 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Created reservations ['9ba2bcbf-cb5b-49d6-9e62-0736f30164df', '590719ce-881b-405c-b79c-ad28bda90eb0', '329a2d22-b623-433d-bd02-733bf864ffab', '44efbd5b-84a5-4185-90d8-8aab60233bf6'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:49:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:54 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:49:54 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:55 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-5a2d7bd3-7283-4285-8046-596b348ec6e0 tempest-GroupSnapshotsTest-207098367 None] Group tempest-GroupSnapshotsTest-Group-709488229: creating Jul 03 13:49:55 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-5a2d7bd3-7283-4285-8046-596b348ec6e0 tempest-GroupSnapshotsTest-207098367 None] Group tempest-GroupSnapshotsTest-Group-709488229: created successfully Jul 03 13:49:55 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-5a2d7bd3-7283-4285-8046-596b348ec6e0 tempest-GroupSnapshotsTest-207098367 None] Create group completed successfully. Jul 03 13:49:55 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.373s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:49:55 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-46adf0ee-cd2d-4611-9f84-3d7b1995cd10 tempest-GroupSnapshotsTest-207098367 None] Delete group completed successfully. Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Flow 'volume_create_manager' (d8c52a38-2740-4c24-b3b7-820eafd3e938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ecca3e-c9b1-4a24-a112-96b8fe3f664d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ecca3e-c9b1-4a24-a112-96b8fe3f664d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1462078047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5179ab6d-1fb8-44c3-973f-ca7aebe9b448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be43d80752844188a7ed9223b768d65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:49:56Z,use_quota=True,user_id='afbf2a578be049a5b4ed547d8d949c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878a9208-f403-4f5c-b8b7-2afe152fa949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878a9208-f403-4f5c-b8b7-2afe152fa949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2842152b-d5c8-435a-9cd9-1fe3f4e5e6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2842152b-d5c8-435a-9cd9-1fe3f4e5e6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5179ab6d-1fb8-44c3-973f-ca7aebe9b448', 'volume_name': 'volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548483ac-dc54-47f8-b4b2-a2d339585f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548483ac-dc54-47f8-b4b2-a2d339585f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8577c1-f87a-490d-9cd9-ef7b65bcfdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:55 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Volume 5179ab6d-1fb8-44c3-973f-ca7aebe9b448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448', 'volume_size': 1} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1462078047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5179ab6d-1fb8-44c3-973f-ca7aebe9b448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be43d80752844188a7ed9223b768d65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:49:56Z,use_quota=True,user_id='afbf2a578be049a5b4ed547d8d949c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Creating volume 5179ab6d-1fb8-44c3-973f-ca7aebe9b448 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:49:55 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:49:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:55 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448 1073741824 Jul 03 13:49:55 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:56 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:49:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Flow 'volume_create_manager' (0e6a86f5-b4b8-4fe7-a1d2-57f64d5eec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:49:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e08017-9bd7-40a6-ba23-dd00f02691a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e08017-9bd7-40a6-ba23-dd00f02691a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1347035567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc18b50-2836-4594-a545-c5a8c1572d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a437a0d0800948c6873d26d2a0ad780f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:49:57Z,use_quota=True,user_id='e81a186dc58c4395a376437b8d8d4e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(878d4e54-c13b-456c-991f-86368ff287d8),volume_type_id=878d4e54-c13b-456c-991f-86368ff287d8)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dab8491-ee5d-4f72-867b-277add483182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dab8491-ee5d-4f72-867b-277add483182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b95dd4-4266-4c86-a2bd-4e5f61fe8497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b95dd4-4266-4c86-a2bd-4e5f61fe8497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffc18b50-2836-4594-a545-c5a8c1572d96', 'volume_name': 'volume-ffc18b50-2836-4594-a545-c5a8c1572d96', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef49b510-6af7-4de7-8c1c-b3abbe92a943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef49b510-6af7-4de7-8c1c-b3abbe92a943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28ed8c0-e807-4d3f-98aa-7f5e0f313cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:56 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Volume ffc18b50-2836-4594-a545-c5a8c1572d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffc18b50-2836-4594-a545-c5a8c1572d96', 'volume_size': 1} Jul 03 13:49:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:57 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448 1073741824" returned: 0 in 1.198s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:57 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448 Jul 03 13:49:57 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Flow 'volume_create_manager' (a95d8c63-2a8f-4f43-8625-97cb45c76e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5ecaf0-118f-4878-ae8c-00d9476ce2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5ecaf0-118f-4878-ae8c-00d9476ce2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-866686083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5772b276-9a92-434e-9be2-7079048d76bb,host='devstack@QuobyteHD#QuobyteHD',id=7c9ed431-5997-47a1-86b2-29d6d4242ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad14972439c4d80b9d0261557eca29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:49:57Z,use_quota=True,user_id='70e61123d10242b7b35342bb81f001d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(009eba68-da8d-42f3-bd5b-bff3722c6bd2),volume_type_id=009eba68-da8d-42f3-bd5b-bff3722c6bd2)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949f2041-7087-4b4b-89ad-e2e6b4f2e987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949f2041-7087-4b4b-89ad-e2e6b4f2e987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a62cf08-ad12-4cfa-bd41-80681f866535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a62cf08-ad12-4cfa-bd41-80681f866535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c9ed431-5997-47a1-86b2-29d6d4242ada', 'volume_name': 'volume-7c9ed431-5997-47a1-86b2-29d6d4242ada', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f614935-04c6-471c-8024-8fb5119e2367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f614935-04c6-471c-8024-8fb5119e2367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2010ff-7884-4183-ad91-5aae97777f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:57 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Volume 7c9ed431-5997-47a1-86b2-29d6d4242ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c9ed431-5997-47a1-86b2-29d6d4242ada', 'volume_size': 1} Jul 03 13:49:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:58 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448" returned: 0 in 0.887s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.146s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1347035567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc18b50-2836-4594-a545-c5a8c1572d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a437a0d0800948c6873d26d2a0ad780f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:49:57Z,use_quota=True,user_id='e81a186dc58c4395a376437b8d8d4e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(878d4e54-c13b-456c-991f-86368ff287d8),volume_type_id=878d4e54-c13b-456c-991f-86368ff287d8)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Creating volume ffc18b50-2836-4594-a545-c5a8c1572d96 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:49:58 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ffc18b50-2836-4594-a545-c5a8c1572d96 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8577c1-f87a-490d-9cd9-ef7b65bcfdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb27960f-6d6f-493d-bb3a-fa64e2406a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:49:58 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ffc18b50-2836-4594-a545-c5a8c1572d96 1073741824 Jul 03 13:49:58 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:58 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Volume volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448 (5179ab6d-1fb8-44c3-973f-ca7aebe9b448): created successfully Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb27960f-6d6f-493d-bb3a-fa64e2406a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:49:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Flow 'volume_create_manager' (d8c52a38-2740-4c24-b3b7-820eafd3e938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:49:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-5817c6a2-2358-4f9d-b12f-8c87e1627436 tempest-AttachVolumeShelveTestJSON-1388611776 None] Created volume successfully. Jul 03 13:49:59 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ffc18b50-2836-4594-a545-c5a8c1572d96 1073741824" returned: 0 in 1.131s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ffc18b50-2836-4594-a545-c5a8c1572d96 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:49:59 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ffc18b50-2836-4594-a545-c5a8c1572d96 Jul 03 13:49:59 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:49:59 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Jul 03 13:49:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ffc18b50-2836-4594-a545-c5a8c1572d96" returned: 0 in 0.779s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:49:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:49:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:49:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.550s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5772b276-9a92-434e-9be2-7079048d76bb,created_at=2026-07-03T11:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-866686083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5772b276-9a92-434e-9be2-7079048d76bb,host='devstack@QuobyteHD#QuobyteHD',id=7c9ed431-5997-47a1-86b2-29d6d4242ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad14972439c4d80b9d0261557eca29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:49:57Z,use_quota=True,user_id='70e61123d10242b7b35342bb81f001d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(009eba68-da8d-42f3-bd5b-bff3722c6bd2),volume_type_id=009eba68-da8d-42f3-bd5b-bff3722c6bd2)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:49:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Creating volume 7c9ed431-5997-47a1-86b2-29d6d4242ada {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:49:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:49:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:49:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:50:00 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:50:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28ed8c0-e807-4d3f-98aa-7f5e0f313cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffc18b50-2836-4594-a545-c5a8c1572d96', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36454e1-2e64-4f93-9791-79d16abdec78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:00 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada 1073741824 Jul 03 13:50:00 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:00 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Volume volume-ffc18b50-2836-4594-a545-c5a8c1572d96 (ffc18b50-2836-4594-a545-c5a8c1572d96): created successfully Jul 03 13:50:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36454e1-2e64-4f93-9791-79d16abdec78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Flow 'volume_create_manager' (0e6a86f5-b4b8-4fe7-a1d2-57f64d5eec1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:00 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ea4b2279-2556-4bb7-8345-f6292368b345 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Created volume successfully. Jul 03 13:50:01 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada 1073741824" returned: 0 in 1.016s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:01 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada Jul 03 13:50:01 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3ae3f4a9-9491-4aa9-ab18-4ca8ed7a9cad tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3ae3f4a9-9491-4aa9-ab18-4ca8ed7a9cad tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3f4a9-9491-4aa9-ab18-4ca8ed7a9cad tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3ae3f4a9-9491-4aa9-ab18-4ca8ed7a9cad tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3ae3f4a9-9491-4aa9-ab18-4ca8ed7a9cad tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3ae3f4a9-9491-4aa9-ab18-4ca8ed7a9cad tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:01 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:50:01 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:01 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada" returned: 0 in 0.747s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2010ff-7884-4183-ad91-5aae97777f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9ed431-5997-47a1-86b2-29d6d4242ada', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31010b31-92a5-4644-897e-b558a37e4741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:01 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Volume volume-7c9ed431-5997-47a1-86b2-29d6d4242ada (7c9ed431-5997-47a1-86b2-29d6d4242ada): created successfully Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31010b31-92a5-4644-897e-b558a37e4741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Flow 'volume_create_manager' (a95d8c63-2a8f-4f43-8625-97cb45c76e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:01 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-fd6d8e82-a949-4900-99bb-0f5e94682e12 tempest-GroupSnapshotsTest-207098367 None] Created volume successfully. Jul 03 13:50:02 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3ae3f4a9-9491-4aa9-ab18-4ca8ed7a9cad tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.218s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:02 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-3ae3f4a9-9491-4aa9-ab18-4ca8ed7a9cad tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:50:02 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3ae3f4a9-9491-4aa9-ab18-4ca8ed7a9cad tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Retype volume completed successfully. Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Acquiring lock "cinder-ffc18b50-2836-4594-a545-c5a8c1572d96-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Lock "cinder-ffc18b50-2836-4594-a545-c5a8c1572d96-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Acquiring lock "cinder-quobyte-ffc18b50-2836-4594-a545-c5a8c1572d96" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Lock "cinder-quobyte-ffc18b50-2836-4594-a545-c5a8c1572d96" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[00627d40-a2e4-439f-9318-175797a4681b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ffc18b50-2836-4594-a545-c5a8c1572d96 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:03 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ffc18b50-2836-4594-a545-c5a8c1572d96 Jul 03 13:50:03 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Flow 'volume_create_manager' (287ae887-1490-44f9-81ed-d8046a44b11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58444fc-6c57-4b25-ac21-617199988d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58444fc-6c57-4b25-ac21-617199988d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1119482227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5772b276-9a92-434e-9be2-7079048d76bb,host='devstack@QuobyteHD#QuobyteHD',id=100e2b13-ec16-4139-937b-0d97fcb287b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad14972439c4d80b9d0261557eca29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:50:03Z,use_quota=True,user_id='70e61123d10242b7b35342bb81f001d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(009eba68-da8d-42f3-bd5b-bff3722c6bd2),volume_type_id=009eba68-da8d-42f3-bd5b-bff3722c6bd2)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b915aea-7ccc-41b0-945c-0149037edc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b915aea-7ccc-41b0-945c-0149037edc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ea2089-01fd-42ac-a11e-0ac487c18c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ea2089-01fd-42ac-a11e-0ac487c18c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100e2b13-ec16-4139-937b-0d97fcb287b6', 'volume_name': 'volume-100e2b13-ec16-4139-937b-0d97fcb287b6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5191ef-8a5e-409d-823f-137328368f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5191ef-8a5e-409d-823f-137328368f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ec1beb-cbb6-4118-bc5a-3e662abd70b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:03 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Volume 100e2b13-ec16-4139-937b-0d97fcb287b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100e2b13-ec16-4139-937b-0d97fcb287b6', 'volume_size': 1} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5772b276-9a92-434e-9be2-7079048d76bb,created_at=2026-07-03T11:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1119482227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5772b276-9a92-434e-9be2-7079048d76bb,host='devstack@QuobyteHD#QuobyteHD',id=100e2b13-ec16-4139-937b-0d97fcb287b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad14972439c4d80b9d0261557eca29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:50:03Z,use_quota=True,user_id='70e61123d10242b7b35342bb81f001d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(009eba68-da8d-42f3-bd5b-bff3722c6bd2),volume_type_id=009eba68-da8d-42f3-bd5b-bff3722c6bd2)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Creating volume 100e2b13-ec16-4139-937b-0d97fcb287b6 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:50:03 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:50:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:03 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 1073741824 Jul 03 13:50:03 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:04 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ffc18b50-2836-4594-a545-c5a8c1572d96" returned: 0 in 0.951s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ffc18b50-2836-4594-a545-c5a8c1572d96 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:04 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ffc18b50-2836-4594-a545-c5a8c1572d96 Jul 03 13:50:04 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:04 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 1073741824" returned: 0 in 1.100s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:04 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 Jul 03 13:50:04 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:05 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ffc18b50-2836-4594-a545-c5a8c1572d96" returned: 0 in 0.949s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Lock "cinder-quobyte-ffc18b50-2836-4594-a545-c5a8c1572d96" released by "delete_volume" :: held 1.981s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:05 devstack cinder-volume[86729]: WARNING cinder.quota [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:50:05 devstack cinder-volume[86729]: WARNING cinder.quota [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Created reservations ['e8e03c59-03bd-41d8-be78-ada7451c5f4f', '5b0e95d0-6715-44f7-b439-56d08b7a7e73', 'e566c3ba-7d6a-4205-b526-97e1343a9857', '704986b2-f29e-4dd6-b071-bd4918e348e5'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:05 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:50:05 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:05 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6" returned: 0 in 0.762s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ec1beb-cbb6-4118-bc5a-3e662abd70b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100e2b13-ec16-4139-937b-0d97fcb287b6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8cb48b-b109-4df9-b413-b3f99b2218c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:05 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Volume volume-100e2b13-ec16-4139-937b-0d97fcb287b6 (100e2b13-ec16-4139-937b-0d97fcb287b6): created successfully Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8cb48b-b109-4df9-b413-b3f99b2218c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Flow 'volume_create_manager' (287ae887-1490-44f9-81ed-d8046a44b11c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-bdc7d05a-420c-4349-8bb4-8447a78c54c7 tempest-GroupSnapshotsTest-207098367 None] Created volume successfully. Jul 03 13:50:06 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9e1b0d7c-d763-45e2-9459-aa6907ad54fb tempest-GroupSnapshotsTest-207098367 None] Update group completed successfully. Jul 03 13:50:06 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.149s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:06 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:50:06 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Deleted volume successfully. Jul 03 13:50:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-62197aa3-453c-4249-adb2-01ff742fff82 tempest-VolumeRetypeWithoutMigrationTest-1379326620 None] Lock "cinder-ffc18b50-2836-4594-a545-c5a8c1572d96-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:07 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-5be95e10-7b9d-46f7-93a0-b5f248c099ee tempest-GroupSnapshotsTest-207098367 None] Update group completed successfully. Jul 03 13:50:08 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3586df67-f238-4c52-84e2-28f7a7df47a0 tempest-GroupSnapshotsTest-207098367 None] Update group completed successfully. Jul 03 13:50:10 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-431d6a9e-bf02-4efc-8bef-f160e15f4542 tempest-GroupSnapshotsTest-207098367 None] Update group completed successfully. Jul 03 13:50:11 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] GroupSnapshot 73cfb1eb-1dab-49fc-a567-a533240cb631: creating. Jul 03 13:50:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Group snapshot 73cfb1eb-1dab-49fc-a567-a533240cb631: creating. {{(pid=86729) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 13:50:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Creating offline snapshot 5dbed508-c47c-466e-a5a0-b9e40a157702 of volume 7c9ed431-5997-47a1-86b2-29d6d4242ada {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:50:11 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[47237226-ac4e-46d0-9f99-ae537ddde3ef]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:11 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada Jul 03 13:50:11 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:12 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada" returned: 0 in 0.859s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:12 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 1G Jul 03 13:50:12 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:13 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 1G" returned: 0 in 1.069s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c9ed431-5997-47a1-86b2-29d6d4242ada -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:13 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c9ed431-5997-47a1-86b2-29d6d4242ada -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 Jul 03 13:50:13 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:14 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c9ed431-5997-47a1-86b2-29d6d4242ada -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702" returned: 0 in 0.919s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:14 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:50:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:14 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 Jul 03 13:50:14 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:15 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702" returned: 0 in 0.910s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:15 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.info Jul 03 13:50:15 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-a2981339-e5c3-4540-be92-3e061b942509 req-679d8cc5-36ac-4257-9a49-7745ffcf0cca tempest-AttachVolumeShelveTestJSON-1388611776 None] No connector for attachment e3b0523f-d9ed-4f57-867b-807059d91387; skipping storage backend terminate_connection call. {{(pid=86729) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 03 13:50:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-a2981339-e5c3-4540-be92-3e061b942509 req-679d8cc5-36ac-4257-9a49-7745ffcf0cca tempest-AttachVolumeShelveTestJSON-1388611776 None] Deleting attachment e3b0523f-d9ed-4f57-867b-807059d91387. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:50:16 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.info" returned: 0 in 0.660s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:16 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:50:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:16 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.info Jul 03 13:50:16 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:16 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.info" returned: 0 in 0.697s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.232s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Creating offline snapshot 6fa470f5-30f8-4d60-9715-2ba210af8eea of volume 100e2b13-ec16-4139-937b-0d97fcb287b6 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:50:16 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bd1492-c79f-43a7-ae1e-cc9d5464baf1]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:17 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 Jul 03 13:50:17 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:17 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:50:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Flow 'volume_create_manager' (adda22a9-edff-48c0-ae57-c97d37bfea2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c6df69-8017-4dbd-b3a3-fcd5fbc30760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c6df69-8017-4dbd-b3a3-fcd5fbc30760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1318739506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5893b843-f586-4f96-a062-626910463fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb1b8b69eca474ab609f5a056492b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:50:18Z,use_quota=True,user_id='32584bdaf4b640e19a364b7279a3838d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0253c7d-0426-4ce3-8d00-0793163b2b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0253c7d-0426-4ce3-8d00-0793163b2b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6088a369-6acb-4bdc-b37d-2bfcf2b2380e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:17 devstack cinder-volume[86729]: DEBUG cinder.image.glance [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Creating Keystone auth plugin from conf {{(pid=86729) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 13:50:17 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6" returned: 0 in 0.864s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:17 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea 1G Jul 03 13:50:17 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6088a369-6acb-4bdc-b37d-2bfcf2b2380e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5893b843-f586-4f96-a062-626910463fd8', 'volume_name': 'volume-5893b843-f586-4f96-a062-626910463fd8', 'volume_size': 1, 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24c8a015e6c74647b59cf3465f3aee9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'created_at': datetime.datetime(2026, 7, 3, 11, 40, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 40, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30b7c3b-3dec-488d-9033-410a09266402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30b7c3b-3dec-488d-9033-410a09266402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f094c3ae-9937-42d3-8d43-28559287b065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:18 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Volume 5893b843-f586-4f96-a062-626910463fd8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5893b843-f586-4f96-a062-626910463fd8', 'volume_size': 1, 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24c8a015e6c74647b59cf3465f3aee9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'created_at': datetime.datetime(2026, 7, 3, 11, 40, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 40, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 13:50:18 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Trying to clone 5893b843-f586-4f96-a062-626910463fd8 from image c72364f8-58c5-4ca3-8348-fe92aceb54bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]). {{(pid=86729) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 13:50:18 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 13:50:18 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Image download 20.69 MB at 20.69 MB/s Jul 03 13:50:18 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c84710-a7f1-4b7b-bc2d-9263a5cc45bb]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:18 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea 1G" returned: 0 in 0.886s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100e2b13-ec16-4139-937b-0d97fcb287b6 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:18 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD Jul 03 13:50:18 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:18 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100e2b13-ec16-4139-937b-0d97fcb287b6 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea Jul 03 13:50:18 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:19 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Temporary image c72364f8-58c5-4ca3-8348-fe92aceb54bd is fetched for user 32584bdaf4b640e19a364b7279a3838d. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 13:50:19 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-100e2b13-ec16-4139-937b-0d97fcb287b6 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea" returned: 0 in 0.804s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:19 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd213e3-7e14-47fc-880f-dbe1cc6ae021]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:19 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea Jul 03 13:50:19 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:19 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD Jul 03 13:50:19 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Flow 'volume_create_manager' (bda3f8fd-3474-44c0-b542-8281aaa6a14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b265767-3e9b-42d4-87f4-d85b69f8fb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b265767-3e9b-42d4-87f4-d85b69f8fb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-836610078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61060803-de86-4953-90d8-09dbd2ca2ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19b68f9d5d8a4459bb33d71f3d341bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:50:20Z,use_quota=True,user_id='29361701e14e4164870bab78c3cd44c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41bfc08-88be-430a-a318-e73201e2b630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41bfc08-88be-430a-a318-e73201e2b630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba25054-e310-42a8-8761-ac144892950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba25054-e310-42a8-8761-ac144892950a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61060803-de86-4953-90d8-09dbd2ca2ae7', 'volume_name': 'volume-61060803-de86-4953-90d8-09dbd2ca2ae7', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71637741-edb3-41b8-b53c-199e25db6b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71637741-edb3-41b8-b53c-199e25db6b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e06c4e3-7127-4c58-ae72-b3c883974510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:19 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Volume 61060803-de86-4953-90d8-09dbd2ca2ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61060803-de86-4953-90d8-09dbd2ca2ae7', 'volume_size': 1} Jul 03 13:50:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:20 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea" returned: 0 in 0.806s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:20 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.info Jul 03 13:50:20 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:20 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD" returned: 0 in 0.958s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:21 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.info" returned: 0 in 0.745s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:21 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:21 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.info Jul 03 13:50:21 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:21 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.info" returned: 0 in 0.750s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.971s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.982s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-836610078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61060803-de86-4953-90d8-09dbd2ca2ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19b68f9d5d8a4459bb33d71f3d341bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:50:20Z,use_quota=True,user_id='29361701e14e4164870bab78c3cd44c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Creating volume 61060803-de86-4953-90d8-09dbd2ca2ae7 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:50:21 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:50:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:21 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 1073741824 Jul 03 13:50:21 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:22 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9bebb018-7ea1-46b8-8168-29ca9d0c37f8 tempest-GroupSnapshotsTest-207098367 None] group_snapshot 73cfb1eb-1dab-49fc-a567-a533240cb631: created successfully Jul 03 13:50:22 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 1073741824" returned: 0 in 0.900s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:22 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 Jul 03 13:50:22 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:23 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] group_snapshot 73cfb1eb-1dab-49fc-a567-a533240cb631: deleting Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] group_snapshot 73cfb1eb-1dab-49fc-a567-a533240cb631: deleting {{(pid=86729) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-7c9ed431-5997-47a1-86b2-29d6d4242ada" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-7c9ed431-5997-47a1-86b2-29d6d4242ada" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-5dbed508-c47c-466e-a5a0-b9e40a157702" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-5dbed508-c47c-466e-a5a0-b9e40a157702" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Deleting offline snapshot 5dbed508-c47c-466e-a5a0-b9e40a157702 of volume 7c9ed431-5997-47a1-86b2-29d6d4242ada {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] snapshot_file for this snap is: volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1790a41e-3079-498d-b0f1-bf3bec69c59b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:23 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7" returned: 0 in 0.779s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.119s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1318739506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5893b843-f586-4f96-a062-626910463fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb1b8b69eca474ab609f5a056492b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:50:18Z,use_quota=True,user_id='32584bdaf4b640e19a364b7279a3838d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Creating volume 5893b843-f586-4f96-a062-626910463fd8 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:23 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 Jul 03 13:50:23 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:50:23 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e06c4e3-7127-4c58-ae72-b3c883974510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61060803-de86-4953-90d8-09dbd2ca2ae7', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e55abbeb-54dc-4ef3-825e-d12061b087b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:23 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 1073741824 Jul 03 13:50:23 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:23 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Volume volume-61060803-de86-4953-90d8-09dbd2ca2ae7 (61060803-de86-4953-90d8-09dbd2ca2ae7): created successfully Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e55abbeb-54dc-4ef3-825e-d12061b087b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Flow 'volume_create_manager' (bda3f8fd-3474-44c0-b542-8281aaa6a14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:23 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-01151135-6066-4f71-a885-2069717ce649 tempest-ServerActionsTestOtherA-1902105871 None] Created volume successfully. Jul 03 13:50:24 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702" returned: 0 in 1.043s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c9ed431-5997-47a1-86b2-29d6d4242ada(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:50:24 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d21bdb-50cd-4280-a7dc-eb9beb7e1fac]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:24 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada Jul 03 13:50:24 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:24 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 1073741824" returned: 0 in 1.169s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:24 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 Jul 03 13:50:24 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:25 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada" returned: 0 in 0.885s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:25 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 Jul 03 13:50:25 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:25 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8" returned: 0 in 0.776s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Attempting download of c72364f8-58c5-4ca3-8348-fe92aceb54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}])) to volume 5893b843-f586-4f96-a062-626910463fd8. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dedb320-4f8b-4a9b-8123-0a789903c684]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_7rkqmawq {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:25 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_7rkqmawq Jul 03 13:50:25 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:25 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:50:25 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:26 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702" returned: 0 in 0.839s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:26 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702 Jul 03 13:50:26 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:26 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_7rkqmawq" returned: 0 in 0.895s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_7rkqmawq {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:26 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.702s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:50:26 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_7rkqmawq Jul 03 13:50:26 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:26 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada.5dbed508-c47c-466e-a5a0-b9e40a157702" returned: 0 in 0.719s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-5dbed508-c47c-466e-a5a0-b9e40a157702" released by "_delete_snapshot" :: held 3.611s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-7c9ed431-5997-47a1-86b2-29d6d4242ada" released by "delete_snapshot" :: held 3.637s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-100e2b13-ec16-4139-937b-0d97fcb287b6" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-100e2b13-ec16-4139-937b-0d97fcb287b6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-6fa470f5-30f8-4d60-9715-2ba210af8eea" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-6fa470f5-30f8-4d60-9715-2ba210af8eea" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Deleting offline snapshot 6fa470f5-30f8-4d60-9715-2ba210af8eea of volume 100e2b13-ec16-4139-937b-0d97fcb287b6 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:50:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] snapshot_file for this snap is: volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:50:27 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fba04cc-82dd-4b2e-973b-a1e3b3364c45]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:27 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea Jul 03 13:50:27 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:27 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_7rkqmawq" returned: 1 in 0.946s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_7rkqmawq' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:50:27 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd5a8db-d174-4891-9aa7-a3160009e0fc]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:27 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD Jul 03 13:50:27 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:28 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea" returned: 0 in 1.191s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-100e2b13-ec16-4139-937b-0d97fcb287b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:50:28 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e151f32-cd77-411a-b2cb-174f42ae4287]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:28 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 Jul 03 13:50:28 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:28 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD" returned: 0 in 1.024s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:28 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] c72364f8-58c5-4ca3-8348-fe92aceb54bd was qcow2, converting to raw {{(pid=86729) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 13:50:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:28 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 Jul 03 13:50:28 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:29 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6" returned: 0 in 1.302s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:29 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea Jul 03 13:50:29 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:30 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea" returned: 0 in 1.303s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:30 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea Jul 03 13:50:30 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:31 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8" returned: 0 in 2.891s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:31 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_0l5uyf2tdevstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:50:31 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Converted 112.00 MB image at 38.73 MB/s Jul 03 13:50:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:31 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 1G Jul 03 13:50:31 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:31 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6.6fa470f5-30f8-4d60-9715-2ba210af8eea" returned: 0 in 0.781s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-6fa470f5-30f8-4d60-9715-2ba210af8eea" released by "_delete_snapshot" :: held 4.741s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-100e2b13-ec16-4139-937b-0d97fcb287b6" released by "delete_snapshot" :: held 4.770s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:31 devstack cinder-volume[86729]: WARNING cinder.quota [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1789250128 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1789250128, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:50:31 devstack cinder-volume[86729]: WARNING cinder.quota [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1789250128 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1789250128, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:50:31 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Created reservations ['9dccb7a9-5d42-49d2-8607-f82859d49490', 'f23879c0-cf78-426d-a334-e998bed95300', '3f133877-11fa-4842-843b-3a4cc63b472c', 'a0228b1d-77c5-467e-8ceb-eef8900daf98'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:50:32 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] Created reservations ['0cfd6555-1566-4442-abec-3540bbe7a044', '24f686b4-b13d-43c4-b17c-abe7b449b169', 'fb05572a-fb79-4b5a-b70f-4513bdc58ceb', '683f79bb-55eb-461e-8f81-9d41d3a31b39'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:50:32 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-0b71fa13-7fc4-45bf-b8de-d6f14924cb4f tempest-GroupSnapshotsTest-207098367 None] group_snapshot 73cfb1eb-1dab-49fc-a567-a533240cb631: deleted successfully Jul 03 13:50:32 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 1G" returned: 0 in 0.825s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ba44e9-6fed-455b-928b-fd3c2ebd1bc6]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:32 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 Jul 03 13:50:32 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-100e2b13-ec16-4139-937b-0d97fcb287b6" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-100e2b13-ec16-4139-937b-0d97fcb287b6" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4a330d-3efc-485c-b032-d771c0dfabee]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:32 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 Jul 03 13:50:32 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:33 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8" returned: 0 in 0.821s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:33 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 Jul 03 13:50:33 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:33 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6" returned: 0 in 0.941s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:33 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6 Jul 03 13:50:33 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:34 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8" returned: 1 in 0.874s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Downloaded image c72364f8-58c5-4ca3-8348-fe92aceb54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}])) to volume 5893b843-f586-4f96-a062-626910463fd8 successfully. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Temporary image c72364f8-58c5-4ca3-8348-fe92aceb54bd for user 32584bdaf4b640e19a364b7279a3838d is deleted. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Marking volume 5893b843-f586-4f96-a062-626910463fd8 as bootable. {{(pid=86729) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Copying metadata from image c72364f8-58c5-4ca3-8348-fe92aceb54bd to 5893b843-f586-4f96-a062-626910463fd8. {{(pid=86729) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Creating volume glance metadata for volume 5893b843-f586-4f96-a062-626910463fd8 backed by image c72364f8-58c5-4ca3-8348-fe92aceb54bd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86729) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f094c3ae-9937-42d3-8d43-28559287b065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5893b843-f586-4f96-a062-626910463fd8', 'volume_size': 1, 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24c8a015e6c74647b59cf3465f3aee9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'created_at': datetime.datetime(2026, 7, 3, 11, 40, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 40, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8484ae0-9fa3-4b82-b5c9-a15c7e578e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:34 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Volume volume-5893b843-f586-4f96-a062-626910463fd8 (5893b843-f586-4f96-a062-626910463fd8): created successfully Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8484ae0-9fa3-4b82-b5c9-a15c7e578e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Flow 'volume_create_manager' (adda22a9-edff-48c0-ae57-c97d37bfea2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-94ff7183-8469-402f-a67b-778e12d8c5f3 tempest-VolumesImageMetadata-2199201 None] Created volume successfully. Jul 03 13:50:34 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-100e2b13-ec16-4139-937b-0d97fcb287b6" returned: 0 in 0.688s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-100e2b13-ec16-4139-937b-0d97fcb287b6" released by "delete_volume" :: held 1.719s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-7c9ed431-5997-47a1-86b2-29d6d4242ada" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-7c9ed431-5997-47a1-86b2-29d6d4242ada" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[7500efec-2ca1-493d-9580-1390ab902d57]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:34 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada Jul 03 13:50:34 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Acquiring lock "cinder-5893b843-f586-4f96-a062-626910463fd8-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Lock "cinder-5893b843-f586-4f96-a062-626910463fd8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Acquiring lock "cinder-quobyte-5893b843-f586-4f96-a062-626910463fd8" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Lock "cinder-quobyte-5893b843-f586-4f96-a062-626910463fd8" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:35 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada" returned: 0 in 0.866s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:35 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24e3317-6b32-4d3e-aca8-f60015ae14b3]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:35 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada Jul 03 13:50:35 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:35 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 Jul 03 13:50:35 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:36 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7c9ed431-5997-47a1-86b2-29d6d4242ada" returned: 0 in 0.656s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-7c9ed431-5997-47a1-86b2-29d6d4242ada" released by "delete_volume" :: held 1.580s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Created reservations ['f83de17b-7347-46f8-aae2-1c53fc042408'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:50:36 devstack cinder-volume[86729]: WARNING cinder.quota [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1789250128 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1789250128, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Created reservations ['2f9a0354-880f-4465-9c27-71d1979bfc05', '890a15fd-fb2a-4844-bdc1-1526a1eeb215', '6d0a830f-634d-488f-898d-1162de0b74ad', '491f7dea-aeee-4d1a-960a-05eccee70717'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:50:36 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8" returned: 0 in 0.807s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Created reservations ['419adc31-b4b2-4f8f-bb6e-08c4a4499dd6', '5c69e085-b1f9-4421-af20-5fa9fa8fbb73', '9b9ea453-ac09-4171-9bcb-85f96a3fcb84', 'f44cddd4-014f-4b37-a3e8-d50b7e3f6f36'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:50:36 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 Jul 03 13:50:36 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:36 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:50:36 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:37 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.363s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:38 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:50:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c1cead19-c0fd-41b3-958d-73dc4f31d751 tempest-GroupSnapshotsTest-207098367 None] Delete group completed successfully. Jul 03 13:50:38 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8" returned: 1 in 2.088s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:50:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:38 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8 Jul 03 13:50:38 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:39 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-650d3cd8-f9e7-48d5-a85d-09238a36f695 tempest-GroupSnapshotsTest-207098367 None] Group tempest-GroupSnapshotsTest-Group-383004511: creating Jul 03 13:50:39 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-650d3cd8-f9e7-48d5-a85d-09238a36f695 tempest-GroupSnapshotsTest-207098367 None] Group tempest-GroupSnapshotsTest-Group-383004511: created successfully Jul 03 13:50:39 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-650d3cd8-f9e7-48d5-a85d-09238a36f695 tempest-GroupSnapshotsTest-207098367 None] Create group completed successfully. Jul 03 13:50:40 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5893b843-f586-4f96-a062-626910463fd8" returned: 0 in 1.826s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Lock "cinder-quobyte-5893b843-f586-4f96-a062-626910463fd8" released by "delete_volume" :: held 4.814s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:40 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Created reservations ['804d5621-7222-4ddf-941e-4c39b5b2d876', 'b71b0096-0c82-491a-bb91-161caddcd760', '19e96908-8c21-4c6a-a74c-8db52231ec4e', 'f8ac2ad2-2061-4c7b-ad45-8422a8644523'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:50:40 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=113,cinder:SELECT=115,cinder:INSERT=34,cinder:DELETE=2 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:50:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:40 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:50:40 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Flow 'volume_create_manager' (391a35fe-db7e-4491-8026-f9694bbe7db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4590ec5-0463-421c-bcda-c0d347e2188f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4590ec5-0463-421c-bcda-c0d347e2188f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1732392448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=505c71e4-00c4-405e-8458-1beaaa49b37d,host='devstack@QuobyteHD#QuobyteHD',id=0f15a82c-2143-45d2-8586-e0768bfbbb1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad14972439c4d80b9d0261557eca29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:50:41Z,use_quota=True,user_id='70e61123d10242b7b35342bb81f001d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c686180-74d6-4f7d-9e42-64faee1fda3e),volume_type_id=7c686180-74d6-4f7d-9e42-64faee1fda3e)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e99a32d-6b48-4b03-a17a-6bec3c233027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e99a32d-6b48-4b03-a17a-6bec3c233027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61637d75-8866-4d50-9bdf-963e794da0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61637d75-8866-4d50-9bdf-963e794da0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f15a82c-2143-45d2-8586-e0768bfbbb1a', 'volume_name': 'volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (623e9886-d33f-41b2-a927-4549493004dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (623e9886-d33f-41b2-a927-4549493004dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffffdea-685a-4746-a12b-20e5a8aa9642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:41 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Volume 0f15a82c-2143-45d2-8586-e0768bfbbb1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a', 'volume_size': 1} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=505c71e4-00c4-405e-8458-1beaaa49b37d,created_at=2026-07-03T11:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1732392448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=505c71e4-00c4-405e-8458-1beaaa49b37d,host='devstack@QuobyteHD#QuobyteHD',id=0f15a82c-2143-45d2-8586-e0768bfbbb1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad14972439c4d80b9d0261557eca29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:50:41Z,use_quota=True,user_id='70e61123d10242b7b35342bb81f001d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c686180-74d6-4f7d-9e42-64faee1fda3e),volume_type_id=7c686180-74d6-4f7d-9e42-64faee1fda3e)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Creating volume 0f15a82c-2143-45d2-8586-e0768bfbbb1a {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:50:41 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:50:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:41 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a 1073741824 Jul 03 13:50:41 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:42 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.654s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:42 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:50:42 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Deleted volume successfully. Jul 03 13:50:42 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=124,cinder:SELECT=118,cinder:DELETE=8,cinder:INSERT=31 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:50:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-62104846-192d-43eb-b95f-096b5f462c42 tempest-VolumesImageMetadata-2199201 None] Lock "cinder-5893b843-f586-4f96-a062-626910463fd8-delete_volume" released by "delete_volume" :: held 6.909s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:43 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a 1073741824" returned: 0 in 1.583s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:43 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a Jul 03 13:50:43 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:44 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a" returned: 0 in 0.903s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] <== create_volume: return (2599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:50:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.606s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffffdea-685a-4746-a12b-20e5a8aa9642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce7a568-da63-49d6-81f9-b298d5e37dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:44 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Volume volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a (0f15a82c-2143-45d2-8586-e0768bfbbb1a): created successfully Jul 03 13:50:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce7a568-da63-49d6-81f9-b298d5e37dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Flow 'volume_create_manager' (391a35fe-db7e-4491-8026-f9694bbe7db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:44 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a5531677-7118-4ea5-95f8-552181ef387c tempest-GroupSnapshotsTest-207098367 None] Created volume successfully. Jul 03 13:50:45 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] GroupSnapshot 5790489e-89ca-4f17-8506-1c905d31a046: creating. Jul 03 13:50:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] Group snapshot 5790489e-89ca-4f17-8506-1c905d31a046: creating. {{(pid=86729) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 13:50:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] Creating offline snapshot 643fbea2-36b1-471a-ba0d-20bc99c0f524 of volume 0f15a82c-2143-45d2-8586-e0768bfbbb1a {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:50:46 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[68961c90-572a-4a4f-8bc2-a7bf61ecc83c]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:46 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a Jul 03 13:50:46 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:46 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a" returned: 0 in 0.957s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:47 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 1G Jul 03 13:50:47 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:50:48 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Flow 'volume_create_manager' (1621403a-485f-493b-95bf-d9ab895d4be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4537a414-773b-4243-9c80-94a3bdbb1cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 1G" returned: 0 in 1.176s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:48 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4537a414-773b-4243-9c80-94a3bdbb1cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-223121904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12284c06a68a47e3b288086f747a59ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:50:48Z,use_quota=True,user_id='4357b02f2fbb45f9a10590c4b18e1e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:48 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2835bc-fc13-4271-b558-deb8d236a805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca2835bc-fc13-4271-b558-deb8d236a805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e94df0-4c51-4437-bdb0-b33cfa95e1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e94df0-4c51-4437-bdb0-b33cfa95e1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e', 'volume_name': 'volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b99545-a381-4ae9-8134-940ecc88e323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b99545-a381-4ae9-8134-940ecc88e323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298ff740-374f-4ccd-b8f4-42861653b6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:48 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Volume 9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e', 'volume_size': 1} Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:48 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524" returned: 0 in 0.741s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:48 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:50:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:48 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 Jul 03 13:50:48 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:49 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524" returned: 0 in 0.661s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:49 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.info Jul 03 13:50:49 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:50 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.info" returned: 0 in 0.626s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:50 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:50 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.info Jul 03 13:50:50 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:50 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.info" returned: 0 in 0.617s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.897s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.634s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-223121904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12284c06a68a47e3b288086f747a59ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:50:48Z,use_quota=True,user_id='4357b02f2fbb45f9a10590c4b18e1e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Creating volume 9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:50:50 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:50:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:50 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e 1073741824 Jul 03 13:50:50 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-27148b87-c1df-4a4a-9afb-55b66185539f tempest-GroupSnapshotsTest-207098367 None] group_snapshot 5790489e-89ca-4f17-8506-1c905d31a046: created successfully Jul 03 13:50:51 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] group_snapshot 5790489e-89ca-4f17-8506-1c905d31a046: deleting Jul 03 13:50:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] group_snapshot 5790489e-89ca-4f17-8506-1c905d31a046: deleting {{(pid=86729) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 13:50:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-0f15a82c-2143-45d2-8586-e0768bfbbb1a" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-0f15a82c-2143-45d2-8586-e0768bfbbb1a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-643fbea2-36b1-471a-ba0d-20bc99c0f524" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-643fbea2-36b1-471a-ba0d-20bc99c0f524" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Deleting offline snapshot 643fbea2-36b1-471a-ba0d-20bc99c0f524 of volume 0f15a82c-2143-45d2-8586-e0768bfbbb1a {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:50:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] snapshot_file for this snap is: volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:50:51 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ebb407-bb29-464a-9ac8-17e8aaf7dfa0]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:52 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 Jul 03 13:50:52 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:52 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e 1073741824" returned: 0 in 1.165s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:52 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e Jul 03 13:50:52 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:52 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e" returned: 0 in 0.749s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:52 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:50:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298ff740-374f-4ccd-b8f4-42861653b6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d4b17b-410d-4934-8444-05711019346b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:52 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Volume volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e (9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e): created successfully Jul 03 13:50:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d4b17b-410d-4934-8444-05711019346b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Flow 'volume_create_manager' (1621403a-485f-493b-95bf-d9ab895d4be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:52 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d7f774d8-1560-4075-95d3-1c19a3828ee9 tempest-VolumesTransfersTest-997869358 None] Created volume successfully. Jul 03 13:50:52 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524" returned: 0 in 1.201s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:52 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:50:53 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[7578ceea-48ee-4904-8f91-8f591d9d28d8]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:53 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a Jul 03 13:50:53 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:53 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a" returned: 0 in 0.781s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:53 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 Jul 03 13:50:53 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:54 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-59169302-894b-412a-bd82-26dca5fb74de tempest-VolumesTransfersTest-712491234 None] Transfer volume completed successfully. Jul 03 13:50:54 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524" returned: 0 in 0.762s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:54 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524 Jul 03 13:50:54 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Acquiring lock "cinder-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Lock "cinder-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Acquiring lock "cinder-quobyte-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Lock "cinder-quobyte-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[38755890-8c48-4c33-8cec-03a3c521ee55]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:55 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e Jul 03 13:50:55 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:55 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a.643fbea2-36b1-471a-ba0d-20bc99c0f524" returned: 0 in 0.718s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-643fbea2-36b1-471a-ba0d-20bc99c0f524" released by "_delete_snapshot" :: held 3.586s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-0f15a82c-2143-45d2-8586-e0768bfbbb1a" released by "delete_snapshot" :: held 3.625s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:55 devstack cinder-volume[86729]: WARNING cinder.quota [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-924915344 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-924915344, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:50:55 devstack cinder-volume[86729]: WARNING cinder.quota [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-924915344 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-924915344, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:50:55 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] Created reservations ['438c4e89-c1f0-4c66-b01f-8b6188b57820', '086fdba4-945b-4662-959b-8ca2a580f156', '16c593c1-9dac-4cb6-b5aa-7be34649149d', 'ca0ca11a-1deb-46c5-b147-bb8834ec48f6'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:50:55 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-35cd7429-8bb3-4828-b715-6ed539321e57 tempest-GroupSnapshotsTest-207098367 None] group_snapshot 5790489e-89ca-4f17-8506-1c905d31a046: deleted successfully Jul 03 13:50:55 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e" returned: 0 in 0.778s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:55 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e Jul 03 13:50:55 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "cinder-quobyte-0f15a82c-2143-45d2-8586-e0768bfbbb1a" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-0f15a82c-2143-45d2-8586-e0768bfbbb1a" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d1597d-2308-48b6-87ca-5839f051838d]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:56 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e" returned: 0 in 0.653s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Lock "cinder-quobyte-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e" released by "delete_volume" :: held 1.486s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Created reservations ['9c2812ae-38c5-41fc-8408-d40a539f56f0', '080f778c-54eb-4546-bcc6-a8645961a0c6', '3baf1d61-4da6-4cf0-8234-345f3e82d1d3', '56368540-f8cb-45f7-bbe7-8a5f49a6b317'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:50:56 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a Jul 03 13:50:56 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:56 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:50:56 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:57 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a" returned: 0 in 0.761s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:57 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a Jul 03 13:50:57 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:57 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.718s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:50:57 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Deleted volume successfully. Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f4eca836-1e61-4362-ad59-fcd47c656588 tempest-VolumesTransfersTest-1231080759 None] Lock "cinder-9ff4bdbd-3706-4a1d-9dfb-8de4d617ee9e-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Flow 'volume_create_manager' (836f33e4-e428-470c-8151-90ee7899fcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583878d6-6097-451f-bc31-6f08c23da537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583878d6-6097-451f-bc31-6f08c23da537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-780913826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a016111-b24f-4922-856c-d98e6a2ffb2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12284c06a68a47e3b288086f747a59ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:50:58Z,use_quota=True,user_id='4357b02f2fbb45f9a10590c4b18e1e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed207627-c37c-44e2-bf9b-9ff67f1b2a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed207627-c37c-44e2-bf9b-9ff67f1b2a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab90061c-d5cc-446a-8484-a9d853e4d965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab90061c-d5cc-446a-8484-a9d853e4d965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a016111-b24f-4922-856c-d98e6a2ffb2b', 'volume_name': 'volume-4a016111-b24f-4922-856c-d98e6a2ffb2b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634fe6c4-dabc-4c48-9a7c-30f96701acfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634fe6c4-dabc-4c48-9a7c-30f96701acfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d94103-5c76-4577-a6e1-aaa6d9cf7f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:57 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Volume 4a016111-b24f-4922-856c-d98e6a2ffb2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a016111-b24f-4922-856c-d98e6a2ffb2b', 'volume_size': 1} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-780913826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a016111-b24f-4922-856c-d98e6a2ffb2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12284c06a68a47e3b288086f747a59ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:50:58Z,use_quota=True,user_id='4357b02f2fbb45f9a10590c4b18e1e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Creating volume 4a016111-b24f-4922-856c-d98e6a2ffb2b {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:50:57 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a016111-b24f-4922-856c-d98e6a2ffb2b 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:57 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a016111-b24f-4922-856c-d98e6a2ffb2b 1073741824 Jul 03 13:50:57 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:57 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0f15a82c-2143-45d2-8586-e0768bfbbb1a" returned: 0 in 0.694s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Lock "cinder-quobyte-0f15a82c-2143-45d2-8586-e0768bfbbb1a" released by "delete_volume" :: held 1.517s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:50:58 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Created reservations ['77e3b8c4-525e-44f4-ab80-f2ba9249ebeb'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:50:58 devstack cinder-volume[86729]: WARNING cinder.quota [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-924915344 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-924915344, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:50:58 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Created reservations ['574775b2-373c-440b-977b-e9125bf209c3', 'e232a958-4005-40d6-9a8b-e01f04554e28', '6a41cf1d-1f37-4e6e-bee4-8196ec5a0cf1', 'afa933f3-35d9-4f4c-abf3-cb0a147ebca6'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:50:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:50:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:50:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:50:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:50:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:58 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:50:58 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:58 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a016111-b24f-4922-856c-d98e6a2ffb2b 1073741824" returned: 0 in 0.863s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a016111-b24f-4922-856c-d98e6a2ffb2b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:50:58 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a016111-b24f-4922-856c-d98e6a2ffb2b Jul 03 13:50:58 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:50:58 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.718s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:58 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:50:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-68b4eb27-7c9d-4bea-a994-0db7d94cf0d9 tempest-GroupSnapshotsTest-207098367 None] Delete group completed successfully. Jul 03 13:50:59 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Jul 03 13:50:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a016111-b24f-4922-856c-d98e6a2ffb2b" returned: 0 in 0.717s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:50:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:50:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:50:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d94103-5c76-4577-a6e1-aaa6d9cf7f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a016111-b24f-4922-856c-d98e6a2ffb2b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1dbbcb-3a41-4a80-a089-440b867012a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:50:59 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Volume volume-4a016111-b24f-4922-856c-d98e6a2ffb2b (4a016111-b24f-4922-856c-d98e6a2ffb2b): created successfully Jul 03 13:50:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1dbbcb-3a41-4a80-a089-440b867012a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:50:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Flow 'volume_create_manager' (836f33e4-e428-470c-8151-90ee7899fcd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:50:59 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-72554d35-55ce-4493-a007-9c2aafecb95a tempest-VolumesTransfersTest-997869358 None] Created volume successfully. Jul 03 13:51:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Acquiring lock "cinder-4a016111-b24f-4922-856c-d98e6a2ffb2b-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Lock "cinder-4a016111-b24f-4922-856c-d98e6a2ffb2b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Acquiring lock "cinder-quobyte-4a016111-b24f-4922-856c-d98e6a2ffb2b" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Lock "cinder-quobyte-4a016111-b24f-4922-856c-d98e6a2ffb2b" acquired by "delete_volume" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:00 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a5b384-a453-4493-ae9f-41a14679e234]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a016111-b24f-4922-856c-d98e6a2ffb2b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:00 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a016111-b24f-4922-856c-d98e6a2ffb2b Jul 03 13:51:00 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:01 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a016111-b24f-4922-856c-d98e6a2ffb2b" returned: 0 in 1.033s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a016111-b24f-4922-856c-d98e6a2ffb2b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:01 devstack sudo[91480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a016111-b24f-4922-856c-d98e6a2ffb2b Jul 03 13:51:01 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:02 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a016111-b24f-4922-856c-d98e6a2ffb2b" returned: 0 in 0.780s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Lock "cinder-quobyte-4a016111-b24f-4922-856c-d98e6a2ffb2b" released by "delete_volume" :: held 1.857s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:02 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Created reservations ['450d88bb-1564-4ef1-8a3d-5657e9b1bfda', 'bc3fccab-bac4-4796-9a75-387390b101c9', 'db2ed814-0c8d-4923-9827-90746a75e456', '61313a01-04cc-4ff9-b036-3e4fd5e80407'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:51:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:02 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:51:02 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:03 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.072s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:03 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:03 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Deleted volume successfully. Jul 03 13:51:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-63df8ec3-bbdd-42e0-b63a-e9b2a3ce0d6f tempest-VolumesTransfersTest-1231080759 None] Lock "cinder-4a016111-b24f-4922-856c-d98e6a2ffb2b-delete_volume" released by "delete_volume" :: held 3.156s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-0c3baaf3-ca0b-45e6-aae6-dd0f9f65e6c1 req-f68d2488-7156-413d-b99d-689c84e9b49d tempest-ServerActionsTestOtherA-1902105871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-0c3baaf3-ca0b-45e6-aae6-dd0f9f65e6c1 req-f68d2488-7156-413d-b99d-689c84e9b49d tempest-ServerActionsTestOtherA-1902105871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:07 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e58103-77cf-44e0-a042-8a9c4a316384]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-0c3baaf3-ca0b-45e6-aae6-dd0f9f65e6c1 req-f68d2488-7156-413d-b99d-689c84e9b49d tempest-ServerActionsTestOtherA-1902105871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:08 devstack sudo[91549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 Jul 03 13:51:08 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:08 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-0c3baaf3-ca0b-45e6-aae6-dd0f9f65e6c1 req-f68d2488-7156-413d-b99d-689c84e9b49d tempest-ServerActionsTestOtherA-1902105871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7" returned: 0 in 1.029s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-0c3baaf3-ca0b-45e6-aae6-dd0f9f65e6c1 req-f68d2488-7156-413d-b99d-689c84e9b49d tempest-ServerActionsTestOtherA-1902105871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.051s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:09 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-0c3baaf3-ca0b-45e6-aae6-dd0f9f65e6c1 req-f68d2488-7156-413d-b99d-689c84e9b49d tempest-ServerActionsTestOtherA-1902105871 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-61060803-de86-4953-90d8-09dbd2ca2ae7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c8be5a2-97b9-40df-8ad5-b20a18b4a60d', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:51:09 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-0c3baaf3-ca0b-45e6-aae6-dd0f9f65e6c1 req-f68d2488-7156-413d-b99d-689c84e9b49d tempest-ServerActionsTestOtherA-1902105871 None] attachment_update completed successfully. Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Flow 'volume_create_manager' (387d5bcc-44f7-4cd5-9483-ac8e5bbc4499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720aba90-f6d0-4a25-b19e-23160abfd4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720aba90-f6d0-4a25-b19e-23160abfd4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-110779149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85eab18c-23fb-4b41-ae79-3b10f0b56285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c50e693f0746f4abd9a55d7b112fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:11Z,use_quota=True,user_id='dcc9d866f02448ce9934d4842d497ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be99493-bdf1-4acf-a92e-4b38c258cf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be99493-bdf1-4acf-a92e-4b38c258cf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d424f31-a372-45e8-be71-a7b897b59578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d424f31-a372-45e8-be71-a7b897b59578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85eab18c-23fb-4b41-ae79-3b10f0b56285', 'volume_name': 'volume-85eab18c-23fb-4b41-ae79-3b10f0b56285', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06130e3d-010c-4258-b89e-06f1ae97419f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06130e3d-010c-4258-b89e-06f1ae97419f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583c1c58-b659-4862-851b-bbc47d534519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:10 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Volume 85eab18c-23fb-4b41-ae79-3b10f0b56285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85eab18c-23fb-4b41-ae79-3b10f0b56285', 'volume_size': 1} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-110779149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85eab18c-23fb-4b41-ae79-3b10f0b56285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c50e693f0746f4abd9a55d7b112fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:11Z,use_quota=True,user_id='dcc9d866f02448ce9934d4842d497ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Creating volume 85eab18c-23fb-4b41-ae79-3b10f0b56285 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:51:10 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:51:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:10 devstack sudo[91937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 1073741824 Jul 03 13:51:10 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:11 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 1073741824" returned: 0 in 0.943s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:11 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 Jul 03 13:51:11 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Acquiring lock "cinder-5179ab6d-1fb8-44c3-973f-ca7aebe9b448-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Lock "cinder-5179ab6d-1fb8-44c3-973f-ca7aebe9b448-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Acquiring lock "cinder-quobyte-5179ab6d-1fb8-44c3-973f-ca7aebe9b448" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Lock "cinder-quobyte-5179ab6d-1fb8-44c3-973f-ca7aebe9b448" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c489a883-5930-43a6-8a78-b602e84b14cd]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:12 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448 Jul 03 13:51:12 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:12 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a1c137ba-69e9-4ba9-b1bb-aa839961ce8f tempest-GroupsTest-1713160931 None] Group tempest-Group1-158488421: creating Jul 03 13:51:12 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a1c137ba-69e9-4ba9-b1bb-aa839961ce8f tempest-GroupsTest-1713160931 None] Group tempest-Group1-158488421: created successfully Jul 03 13:51:12 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a1c137ba-69e9-4ba9-b1bb-aa839961ce8f tempest-GroupsTest-1713160931 None] Create group completed successfully. Jul 03 13:51:12 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285" returned: 0 in 0.722s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583c1c58-b659-4862-851b-bbc47d534519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85eab18c-23fb-4b41-ae79-3b10f0b56285', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab74f4c-202f-4819-a4ed-40d585957506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:12 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Volume volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 (85eab18c-23fb-4b41-ae79-3b10f0b56285): created successfully Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab74f4c-202f-4819-a4ed-40d585957506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Flow 'volume_create_manager' (387d5bcc-44f7-4cd5-9483-ac8e5bbc4499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:12 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6acc5cf7-0a67-4e04-b18f-27aa71d9e7b7 tempest-VolumesCloneTest-1566234015 None] Created volume successfully. Jul 03 13:51:12 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448" returned: 0 in 0.800s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:12 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448 Jul 03 13:51:12 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Flow 'volume_create_manager' (b04f0ffe-bc80-4d3a-9b12-15017eb7c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa10178-282e-4b70-81e6-f46241a294df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa10178-282e-4b70-81e6-f46241a294df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-878076053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb0cf10-d7f3-4058-ae4f-1f0425796021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c50e693f0746f4abd9a55d7b112fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=85eab18c-23fb-4b41-ae79-3b10f0b56285,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:13Z,use_quota=True,user_id='dcc9d866f02448ce9934d4842d497ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43063b7d-4835-4461-811b-3dd70dcf5974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43063b7d-4835-4461-811b-3dd70dcf5974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc8e6f6-128b-4756-8230-f52bc1ebe24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc8e6f6-128b-4756-8230-f52bc1ebe24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7fb0cf10-d7f3-4058-ae4f-1f0425796021', 'volume_name': 'volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021', 'volume_size': 2, 'source_volid': '85eab18c-23fb-4b41-ae79-3b10f0b56285', 'source_volstatus': 'available'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e912b229-1b02-42ae-954c-8968bf46d651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e912b229-1b02-42ae-954c-8968bf46d651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fddf3f-54d8-489c-b611-6fd519d62c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:13 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Volume 7fb0cf10-d7f3-4058-ae4f-1f0425796021: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021', 'volume_size': 2, 'source_volid': '85eab18c-23fb-4b41-ae79-3b10f0b56285', 'source_volstatus': 'available'} Jul 03 13:51:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-183dfd95-c3c9-4eae-ba2e-47f07fa6497b tempest-GroupsTest-1713160931 None] Group tempest-Group2-102225801: creating Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:13 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Cloning volume 85eab18c-23fb-4b41-ae79-3b10f0b56285 to volume 7fb0cf10-d7f3-4058-ae4f-1f0425796021 Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Creating offline snapshot 0bfac788-3e34-4155-9248-8ca243a8686f of volume 85eab18c-23fb-4b41-ae79-3b10f0b56285 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:51:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-183dfd95-c3c9-4eae-ba2e-47f07fa6497b tempest-GroupsTest-1713160931 None] Group tempest-Group2-102225801: created successfully Jul 03 13:51:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-183dfd95-c3c9-4eae-ba2e-47f07fa6497b tempest-GroupsTest-1713160931 None] Create group completed successfully. Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8787b5a0-34c7-461e-a2db-0ee7714097a7]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:13 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5179ab6d-1fb8-44c3-973f-ca7aebe9b448" returned: 0 in 0.740s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Lock "cinder-quobyte-5179ab6d-1fb8-44c3-973f-ca7aebe9b448" released by "delete_volume" :: held 1.582s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Created reservations ['3c8f0f5d-1088-4836-8c2e-0ed53a378595', '0094fc79-69c5-47e8-9804-5ecaec30b93b', '04f09997-2be6-4b8f-9457-21b830c011b3', '23f758fe-a754-4d20-81f0-c01a2fa327c6'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:51:13 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 Jul 03 13:51:13 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:13 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:51:13 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:14 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285" returned: 0 in 0.846s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:14 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f 1G Jul 03 13:51:14 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:14 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.742s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:14 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:14 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Deleted volume successfully. Jul 03 13:51:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c6ec5873-2f70-40d7-aa70-fb97c38ab9b9 tempest-AttachVolumeShelveTestJSON-1388611776 None] Lock "cinder-5179ab6d-1fb8-44c3-973f-ca7aebe9b448-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Flow 'volume_create_manager' (3f6b07c0-a36f-4245-82ce-1ea34bfc6fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd71bbb-7532-4930-aa9b-325fb50eb072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd71bbb-7532-4930-aa9b-325fb50eb072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1249782411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c102819f-bd91-4eee-9077-c6ff623f4c9f,host='devstack@QuobyteHD#QuobyteHD',id=415d27d4-769d-4be2-8ee2-0400ff0a72bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b194a113697b41eba3472083ec47d330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:16Z,use_quota=True,user_id='18c5bdf9d36a439cbc36a2db86c1dac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af316c75-5d8e-40ec-b874-67237f92bd4d),volume_type_id=af316c75-5d8e-40ec-b874-67237f92bd4d)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcb8fd7-c67d-4627-b7a9-2455d5970f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcb8fd7-c67d-4627-b7a9-2455d5970f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2fcef4-be44-425d-9d84-9feab6bf0dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2fcef4-be44-425d-9d84-9feab6bf0dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '415d27d4-769d-4be2-8ee2-0400ff0a72bb', 'volume_name': 'volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa1fa03-4eee-4622-9c51-b4a3f073b9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa1fa03-4eee-4622-9c51-b4a3f073b9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0ada2e-c098-4495-bee7-ec93a5537bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:15 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Volume 415d27d4-769d-4be2-8ee2-0400ff0a72bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb', 'volume_size': 1} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:15 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f 1G" returned: 0 in 1.226s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:15 devstack sudo[91972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f Jul 03 13:51:15 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:16 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f" returned: 0 in 0.729s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:16 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f is being set with open permissions: ugo+rw Jul 03 13:51:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:16 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f Jul 03 13:51:16 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:17 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f" returned: 0 in 0.672s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:17 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.info Jul 03 13:51:17 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-aa620b38-1aad-4b4b-88c4-42195c07643e req-51431c48-f4a3-4784-8abd-e4de95d00669 tempest-ServerActionsTestOtherA-1902105871 None] Terminate volume connection completed successfully. Jul 03 13:51:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-aa620b38-1aad-4b4b-88c4-42195c07643e req-51431c48-f4a3-4784-8abd-e4de95d00669 tempest-ServerActionsTestOtherA-1902105871 None] Deleting attachment 3c8be5a2-97b9-40df-8ad5-b20a18b4a60d. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:51:18 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.info" returned: 0 in 0.934s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:18 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.info is being set with open permissions: ugo+rw Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:18 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.info Jul 03 13:51:18 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:18 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.info" returned: 0 in 0.789s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Acquiring lock "cinder-quobyte-7fb0cf10-d7f3-4058-ae4f-1f0425796021" by "_copy_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Lock "cinder-quobyte-7fb0cf10-d7f3-4058-ae4f-1f0425796021" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] snapshot: 0bfac788-3e34-4155-9248-8ca243a8686f, volume: 7fb0cf10-d7f3-4058-ae4f-1f0425796021, {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[55763523-123c-40b6-8f7b-cc3a633c802f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:19 devstack sudo[92067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f Jul 03 13:51:19 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:19 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f" returned: 0 in 0.941s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85eab18c-23fb-4b41-ae79-3b10f0b56285(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:51:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] will copy from snapshot at /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:51:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Creating direct copy from snapshot {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:51:19 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6074ce7b-e440-481b-96ac-21624a5e6a72]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:20 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 Jul 03 13:51:20 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-aa620b38-1aad-4b4b-88c4-42195c07643e req-846c4d58-ed02-4f50-a333-791e972c1300 tempest-ServerActionsTestOtherA-1902105871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:20 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285" returned: 0 in 0.861s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:20 devstack cinder-volume[86729]: DEBUG cinder.utils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Path /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021 not found in is_blk_device check {{(pid=86729) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:51:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:20 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021 Jul 03 13:51:20 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:51:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:26 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:51:26 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:26 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021" returned: 0 in 5.768s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:26 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb980c8-116b-462a-ad76-f50984d26120]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:26 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 Jul 03 13:51:26 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:27 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.172s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:27 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:27 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285" returned: 0 in 1.096s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:27 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:51:27 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Converted 1024.00 MB image at 177.50 MB/s Jul 03 13:51:27 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021 is being set with open permissions: ugo+rw Jul 03 13:51:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:27 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021 Jul 03 13:51:27 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:28 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021" returned: 0 in 0.695s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Lock "cinder-quobyte-7fb0cf10-d7f3-4058-ae4f-1f0425796021" released by "_copy_volume_from_snapshot" :: held 9.470s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Acquiring lock "cinder-quobyte-0bfac788-3e34-4155-9248-8ca243a8686f" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Lock "cinder-quobyte-0bfac788-3e34-4155-9248-8ca243a8686f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Deleting offline snapshot 0bfac788-3e34-4155-9248-8ca243a8686f of volume 85eab18c-23fb-4b41-ae79-3b10f0b56285 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:51:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] snapshot_file for this snap is: volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:51:28 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[372db2ad-9cfc-402d-ba59-322cedda5c83]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:28 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f Jul 03 13:51:28 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:29 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f" returned: 0 in 0.810s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85eab18c-23fb-4b41-ae79-3b10f0b56285(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:51:29 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[861f1523-f6ad-42bf-ae7e-5e8a9230247a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:29 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 Jul 03 13:51:29 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:30 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285" returned: 0 in 0.859s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:30 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f Jul 03 13:51:30 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:31 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f" returned: 0 in 0.811s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:31 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f Jul 03 13:51:31 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:31 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285.0bfac788-3e34-4155-9248-8ca243a8686f" returned: 0 in 0.686s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Lock "cinder-quobyte-0bfac788-3e34-4155-9248-8ca243a8686f" released by "_delete_snapshot" :: held 3.284s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.198s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.078s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c102819f-bd91-4eee-9077-c6ff623f4c9f,created_at=2026-07-03T11:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1249782411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c102819f-bd91-4eee-9077-c6ff623f4c9f,host='devstack@QuobyteHD#QuobyteHD',id=415d27d4-769d-4be2-8ee2-0400ff0a72bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b194a113697b41eba3472083ec47d330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:16Z,use_quota=True,user_id='18c5bdf9d36a439cbc36a2db86c1dac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af316c75-5d8e-40ec-b874-67237f92bd4d),volume_type_id=af316c75-5d8e-40ec-b874-67237f92bd4d)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Creating volume 415d27d4-769d-4be2-8ee2-0400ff0a72bb {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:51:31 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fddf3f-54d8-489c-b611-6fd519d62c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021', 'volume_size': 2, 'source_volid': '85eab18c-23fb-4b41-ae79-3b10f0b56285', 'source_volstatus': 'available'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:31 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb 1073741824 Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a1728e-0ed4-41d1-bd46-2c96478df9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:31 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:31 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Volume volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021 (7fb0cf10-d7f3-4058-ae4f-1f0425796021): created successfully Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a1728e-0ed4-41d1-bd46-2c96478df9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Flow 'volume_create_manager' (b04f0ffe-bc80-4d3a-9b12-15017eb7c404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:31 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9b78f6aa-e4c8-4e75-899e-4b5d057d0f2b tempest-VolumesCloneTest-1566234015 None] Created volume successfully. Jul 03 13:51:32 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb 1073741824" returned: 0 in 1.019s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:32 devstack sudo[92190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb Jul 03 13:51:32 devstack sudo[92190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Acquiring lock "cinder-7fb0cf10-d7f3-4058-ae4f-1f0425796021-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Lock "cinder-7fb0cf10-d7f3-4058-ae4f-1f0425796021-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Acquiring lock "cinder-quobyte-7fb0cf10-d7f3-4058-ae4f-1f0425796021" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Lock "cinder-quobyte-7fb0cf10-d7f3-4058-ae4f-1f0425796021" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff98c0f8-0967-4e9f-b949-0a11e5167556]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:33 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021 Jul 03 13:51:33 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:33 devstack sudo[92190]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb" returned: 0 in 0.762s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-aa620b38-1aad-4b4b-88c4-42195c07643e req-846c4d58-ed02-4f50-a333-791e972c1300 tempest-ServerActionsTestOtherA-1902105871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.145s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0ada2e-c098-4495-bee7-ec93a5537bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9f2f89-fb29-4af8-9d46-d99950c47a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec32fe04-2dfb-4755-b1ec-ee087becfb7a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-aa620b38-1aad-4b4b-88c4-42195c07643e req-846c4d58-ed02-4f50-a333-791e972c1300 tempest-ServerActionsTestOtherA-1902105871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:33 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Volume volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb (415d27d4-769d-4be2-8ee2-0400ff0a72bb): created successfully Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9f2f89-fb29-4af8-9d46-d99950c47a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Flow 'volume_create_manager' (3f6b07c0-a36f-4245-82ce-1ea34bfc6fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:33 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e5fb9bd3-e012-4b46-8391-c36220993579 tempest-GroupsTest-1713160931 None] Created volume successfully. Jul 03 13:51:33 devstack sudo[92195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 Jul 03 13:51:33 devstack sudo[92195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:34 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021" returned: 0 in 0.964s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:34 devstack sudo[92200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021 Jul 03 13:51:34 devstack sudo[92200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:34 devstack sudo[92195]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-aa620b38-1aad-4b4b-88c4-42195c07643e req-846c4d58-ed02-4f50-a333-791e972c1300 tempest-ServerActionsTestOtherA-1902105871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7" returned: 0 in 0.961s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-aa620b38-1aad-4b4b-88c4-42195c07643e req-846c4d58-ed02-4f50-a333-791e972c1300 tempest-ServerActionsTestOtherA-1902105871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.994s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-aa620b38-1aad-4b4b-88c4-42195c07643e req-846c4d58-ed02-4f50-a333-791e972c1300 tempest-ServerActionsTestOtherA-1902105871 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-61060803-de86-4953-90d8-09dbd2ca2ae7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41a09acb-d8bb-4a9a-88c9-241564e6495c', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:51:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Acquiring lock "cinder-quobyte-415d27d4-769d-4be2-8ee2-0400ff0a72bb" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Lock "cinder-quobyte-415d27d4-769d-4be2-8ee2-0400ff0a72bb" acquired by "delete_volume" :: waited 0.038s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-aa620b38-1aad-4b4b-88c4-42195c07643e req-846c4d58-ed02-4f50-a333-791e972c1300 tempest-ServerActionsTestOtherA-1902105871 None] attachment_update completed successfully. Jul 03 13:51:34 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e933de3-5b4c-4d56-9797-4ce3b86b8f82]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:34 devstack sudo[92205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb Jul 03 13:51:34 devstack sudo[92205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:35 devstack sudo[92200]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7fb0cf10-d7f3-4058-ae4f-1f0425796021" returned: 0 in 0.925s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Lock "cinder-quobyte-7fb0cf10-d7f3-4058-ae4f-1f0425796021" released by "delete_volume" :: held 1.941s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Created reservations ['bbfeed21-8933-4628-ba09-f0002b44d9ae', 'f5e14606-26a4-4388-af5d-438f0d4b77d6', '6b99113c-15a5-4e41-8a58-95558f254cea', '1909dbee-b5d7-47e8-a8e8-499dc0d3da6c'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:35 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:51:35 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Acquiring lock "cinder-85eab18c-23fb-4b41-ae79-3b10f0b56285-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Lock "cinder-85eab18c-23fb-4b41-ae79-3b10f0b56285-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Acquiring lock "cinder-quobyte-85eab18c-23fb-4b41-ae79-3b10f0b56285" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Lock "cinder-quobyte-85eab18c-23fb-4b41-ae79-3b10f0b56285" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:35 devstack sudo[92205]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb" returned: 0 in 1.022s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d3dedf-0e08-4209-a213-bca355cd5c29]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:35 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb Jul 03 13:51:35 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:35 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 Jul 03 13:51:35 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:36 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.021s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:36 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:36 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Deleted volume successfully. Jul 03 13:51:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0d4d1e64-e422-487d-8304-d750dcabc29f tempest-VolumesCloneTest-1566234015 None] Lock "cinder-7fb0cf10-d7f3-4058-ae4f-1f0425796021-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:36 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-415d27d4-769d-4be2-8ee2-0400ff0a72bb" returned: 0 in 1.119s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:36 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285" returned: 0 in 1.111s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Lock "cinder-quobyte-415d27d4-769d-4be2-8ee2-0400ff0a72bb" released by "delete_volume" :: held 2.216s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:37 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285 Jul 03 13:51:37 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Created reservations ['628e9e82-b4f9-44a6-8aa3-415d9901f886'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:51:37 devstack cinder-volume[86729]: WARNING cinder.quota [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1527149256 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1527149256, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:51:37 devstack cinder-volume[86729]: WARNING cinder.quota [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1527149256 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1527149256, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Created reservations ['2040d24e-7c5c-4f53-a405-bf637f5bcd2b', 'eded19f5-0f64-4187-909a-88229e8e1c28', 'e5b49a1a-b3ab-4df4-9f14-470841337ea4', 'd6c7a180-af5b-4bfe-8b1e-f11611271195'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:37 devstack sudo[92238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:51:37 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-37fc405c-b27c-49d3-a528-910c1387df80 tempest-GroupsTest-1713160931 None] Created reservations ['3cb3d9bf-3d0d-48b9-8af6-2fb1adaddf25'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-37fc405c-b27c-49d3-a528-910c1387df80 tempest-GroupsTest-1713160931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-37fc405c-b27c-49d3-a528-910c1387df80 tempest-GroupsTest-1713160931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-37fc405c-b27c-49d3-a528-910c1387df80 tempest-GroupsTest-1713160931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-37fc405c-b27c-49d3-a528-910c1387df80 tempest-GroupsTest-1713160931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-37fc405c-b27c-49d3-a528-910c1387df80 tempest-GroupsTest-1713160931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-37fc405c-b27c-49d3-a528-910c1387df80 tempest-GroupsTest-1713160931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:37 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:51:37 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:37 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-85eab18c-23fb-4b41-ae79-3b10f0b56285" returned: 0 in 0.993s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Lock "cinder-quobyte-85eab18c-23fb-4b41-ae79-3b10f0b56285" released by "delete_volume" :: held 2.203s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Created reservations ['35b72efd-5b78-4156-bbb3-eb3c05358ebd', '493ea69d-e60d-4214-96ff-d566676320ef', '8db1592f-c5e9-43c7-9579-2f459d1f97b6', 'e8a422a5-5eb1-4d0a-95fb-5e8f0301cae7'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:38 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:51:38 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:38 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.912s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d9ae80ed-9f87-4d38-8581-1c60b3afee2f tempest-GroupsTest-1713160931 None] Delete group completed successfully. Jul 03 13:51:38 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-37fc405c-b27c-49d3-a528-910c1387df80 tempest-GroupsTest-1713160931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.945s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-37fc405c-b27c-49d3-a528-910c1387df80 tempest-GroupsTest-1713160931 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-37fc405c-b27c-49d3-a528-910c1387df80 tempest-GroupsTest-1713160931 None] Delete group completed successfully. Jul 03 13:51:38 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.852s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:38 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Deleted volume successfully. Jul 03 13:51:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e6266cb-9eef-4d06-a3db-428499657ad4 tempest-VolumesCloneTest-1566234015 None] Lock "cinder-85eab18c-23fb-4b41-ae79-3b10f0b56285-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:39 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-2b599ee4-369a-458f-b6c6-bd3b09484e9b tempest-GroupsTest-1713160931 None] Group tempest-GroupsTest-Group-203765653: creating Jul 03 13:51:39 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-2b599ee4-369a-458f-b6c6-bd3b09484e9b tempest-GroupsTest-1713160931 None] Group tempest-GroupsTest-Group-203765653: created successfully Jul 03 13:51:39 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-2b599ee4-369a-458f-b6c6-bd3b09484e9b tempest-GroupsTest-1713160931 None] Create group completed successfully. Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=102,cinder:SELECT=94,cinder:DELETE=5,cinder:INSERT=23 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Flow 'volume_create_manager' (3904f4f1-e1c8-4765-bdb8-e71ed805ad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e93bdd7-6d3c-40e8-aaa0-2ce02582ac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e93bdd7-6d3c-40e8-aaa0-2ce02582ac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-398350634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb163a81-4223-4fb3-a9d4-6772bbf7e6e8,host='devstack@QuobyteHD#QuobyteHD',id=d59447fa-2e33-4353-81d9-9681d4aa517e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b194a113697b41eba3472083ec47d330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:41Z,use_quota=True,user_id='18c5bdf9d36a439cbc36a2db86c1dac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e170ea-51b7-498a-a839-f25fcccb7d1a),volume_type_id=59e170ea-51b7-498a-a839-f25fcccb7d1a)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c84e4c-721c-46f4-bca8-f01b5b3a4e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c84e4c-721c-46f4-bca8-f01b5b3a4e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364e9b8d-f750-41c2-8db1-e58bd3df03f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364e9b8d-f750-41c2-8db1-e58bd3df03f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd59447fa-2e33-4353-81d9-9681d4aa517e', 'volume_name': 'volume-d59447fa-2e33-4353-81d9-9681d4aa517e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485d410e-7969-43fe-ac28-7f5041a46cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485d410e-7969-43fe-ac28-7f5041a46cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41877aef-a206-419d-876f-6914d8a73496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:41 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Volume d59447fa-2e33-4353-81d9-9681d4aa517e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d59447fa-2e33-4353-81d9-9681d4aa517e', 'volume_size': 1} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bb163a81-4223-4fb3-a9d4-6772bbf7e6e8,created_at=2026-07-03T11:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-398350634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb163a81-4223-4fb3-a9d4-6772bbf7e6e8,host='devstack@QuobyteHD#QuobyteHD',id=d59447fa-2e33-4353-81d9-9681d4aa517e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b194a113697b41eba3472083ec47d330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:41Z,use_quota=True,user_id='18c5bdf9d36a439cbc36a2db86c1dac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e170ea-51b7-498a-a839-f25fcccb7d1a),volume_type_id=59e170ea-51b7-498a-a839-f25fcccb7d1a)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Creating volume d59447fa-2e33-4353-81d9-9681d4aa517e {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:51:41 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:51:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d59447fa-2e33-4353-81d9-9681d4aa517e 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:41 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d59447fa-2e33-4353-81d9-9681d4aa517e 1073741824 Jul 03 13:51:41 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:43 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d59447fa-2e33-4353-81d9-9681d4aa517e 1073741824" returned: 0 in 1.317s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=98,cinder:INSERT=21,cinder:SELECT=95,cinder:DELETE=6 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d59447fa-2e33-4353-81d9-9681d4aa517e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:43 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d59447fa-2e33-4353-81d9-9681d4aa517e Jul 03 13:51:43 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Flow 'volume_create_manager' (34233000-e11a-469b-bc41-b974b80c657a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2990f4e4-2f36-4751-a451-eae60e5f644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2990f4e4-2f36-4751-a451-eae60e5f644d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-255520660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa002188-b097-4e87-997b-332f714d1609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b7dd4ebd3d244819aa6dd9275eb7cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:44Z,use_quota=True,user_id='77388a9d2d024ae2b90c2e4b0d77f9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fac4fd-a1fd-48b5-8dff-2a869e49cc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fac4fd-a1fd-48b5-8dff-2a869e49cc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c81426-fbb8-4c3f-918e-578b716029b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c81426-fbb8-4c3f-918e-578b716029b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa002188-b097-4e87-997b-332f714d1609', 'volume_name': 'volume-aa002188-b097-4e87-997b-332f714d1609', 'volume_size': 2}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627c2461-2540-462f-8a3f-d0d2a94b57a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627c2461-2540-462f-8a3f-d0d2a94b57a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aea42f0-68ec-42c7-a909-6c2305b1f911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:43 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Volume aa002188-b097-4e87-997b-332f714d1609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa002188-b097-4e87-997b-332f714d1609', 'volume_size': 2} Jul 03 13:51:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:44 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d59447fa-2e33-4353-81d9-9681d4aa517e" returned: 0 in 1.234s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] <== create_volume: return (2633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.636s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.402s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-255520660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa002188-b097-4e87-997b-332f714d1609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b7dd4ebd3d244819aa6dd9275eb7cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:44Z,use_quota=True,user_id='77388a9d2d024ae2b90c2e4b0d77f9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Creating volume aa002188-b097-4e87-997b-332f714d1609 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:51:44 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa002188-b097-4e87-997b-332f714d1609 2147483648 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:44 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa002188-b097-4e87-997b-332f714d1609 2147483648 Jul 03 13:51:44 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41877aef-a206-419d-876f-6914d8a73496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d59447fa-2e33-4353-81d9-9681d4aa517e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b490f4-3bbf-45bb-8933-68b28f424506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:44 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Volume volume-d59447fa-2e33-4353-81d9-9681d4aa517e (d59447fa-2e33-4353-81d9-9681d4aa517e): created successfully Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b490f4-3bbf-45bb-8933-68b28f424506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Flow 'volume_create_manager' (3904f4f1-e1c8-4765-bdb8-e71ed805ad2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:44 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f6b7b51f-dd8a-4510-96b3-c220a48d3b3e tempest-GroupsTest-1713160931 None] Created volume successfully. Jul 03 13:51:45 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa002188-b097-4e87-997b-332f714d1609 2147483648" returned: 0 in 1.212s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa002188-b097-4e87-997b-332f714d1609 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:45 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa002188-b097-4e87-997b-332f714d1609 Jul 03 13:51:45 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Flow 'volume_create_manager' (0244f164-1f39-4cb9-941a-023f38452b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06a5cdb-eb81-4246-8233-f6da0953d4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06a5cdb-eb81-4246-8233-f6da0953d4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-378925569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb163a81-4223-4fb3-a9d4-6772bbf7e6e8,host='devstack@QuobyteHD#QuobyteHD',id=db265dee-3b98-4cca-8d8e-0b79463ab48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b194a113697b41eba3472083ec47d330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:46Z,use_quota=True,user_id='18c5bdf9d36a439cbc36a2db86c1dac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e170ea-51b7-498a-a839-f25fcccb7d1a),volume_type_id=59e170ea-51b7-498a-a839-f25fcccb7d1a)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015bac56-4889-40d2-9463-a7c2e4c47785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015bac56-4889-40d2-9463-a7c2e4c47785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84b8d09-282a-4b71-bffa-66c104ab13a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84b8d09-282a-4b71-bffa-66c104ab13a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db265dee-3b98-4cca-8d8e-0b79463ab48d', 'volume_name': 'volume-db265dee-3b98-4cca-8d8e-0b79463ab48d', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07966638-0493-43ba-8402-f025c7491dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07966638-0493-43ba-8402-f025c7491dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40eba63-6ad7-4872-9d1a-38f30f16fc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:46 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Volume db265dee-3b98-4cca-8d8e-0b79463ab48d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db265dee-3b98-4cca-8d8e-0b79463ab48d', 'volume_size': 1} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:46 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa002188-b097-4e87-997b-332f714d1609" returned: 0 in 0.767s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.197s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bb163a81-4223-4fb3-a9d4-6772bbf7e6e8,created_at=2026-07-03T11:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-378925569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb163a81-4223-4fb3-a9d4-6772bbf7e6e8,host='devstack@QuobyteHD#QuobyteHD',id=db265dee-3b98-4cca-8d8e-0b79463ab48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b194a113697b41eba3472083ec47d330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:46Z,use_quota=True,user_id='18c5bdf9d36a439cbc36a2db86c1dac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e170ea-51b7-498a-a839-f25fcccb7d1a),volume_type_id=59e170ea-51b7-498a-a839-f25fcccb7d1a)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Creating volume db265dee-3b98-4cca-8d8e-0b79463ab48d {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:51:46 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-db265dee-3b98-4cca-8d8e-0b79463ab48d 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aea42f0-68ec-42c7-a909-6c2305b1f911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa002188-b097-4e87-997b-332f714d1609', 'volume_size': 2}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:46 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-db265dee-3b98-4cca-8d8e-0b79463ab48d 1073741824 Jul 03 13:51:46 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46fbcba-e993-4f45-a04e-e37d0533352d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:46 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Volume volume-aa002188-b097-4e87-997b-332f714d1609 (aa002188-b097-4e87-997b-332f714d1609): created successfully Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46fbcba-e993-4f45-a04e-e37d0533352d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Flow 'volume_create_manager' (34233000-e11a-469b-bc41-b974b80c657a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:46 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b4d1792e-417b-4bf7-8e6f-2ae783c09e82 tempest-VolumesCloneNegativeTest-2050951513 None] Created volume successfully. Jul 03 13:51:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Acquiring lock "cinder-aa002188-b097-4e87-997b-332f714d1609-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Lock "cinder-aa002188-b097-4e87-997b-332f714d1609-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Acquiring lock "cinder-quobyte-aa002188-b097-4e87-997b-332f714d1609" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Lock "cinder-quobyte-aa002188-b097-4e87-997b-332f714d1609" acquired by "delete_volume" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf48dae2-bf78-4d8f-8aaa-18a8ed0e58bc]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa002188-b097-4e87-997b-332f714d1609 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:47 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-db265dee-3b98-4cca-8d8e-0b79463ab48d 1073741824" returned: 0 in 0.958s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:47 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa002188-b097-4e87-997b-332f714d1609 Jul 03 13:51:47 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-db265dee-3b98-4cca-8d8e-0b79463ab48d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:47 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-db265dee-3b98-4cca-8d8e-0b79463ab48d Jul 03 13:51:47 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:48 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-db265dee-3b98-4cca-8d8e-0b79463ab48d" returned: 0 in 0.673s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:48 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa002188-b097-4e87-997b-332f714d1609" returned: 0 in 0.847s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa002188-b097-4e87-997b-332f714d1609 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40eba63-6ad7-4872-9d1a-38f30f16fc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db265dee-3b98-4cca-8d8e-0b79463ab48d', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c13354-1bac-4c21-87a9-da5b82b5de28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:48 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa002188-b097-4e87-997b-332f714d1609 Jul 03 13:51:48 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:48 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Volume volume-db265dee-3b98-4cca-8d8e-0b79463ab48d (db265dee-3b98-4cca-8d8e-0b79463ab48d): created successfully Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c13354-1bac-4c21-87a9-da5b82b5de28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Flow 'volume_create_manager' (0244f164-1f39-4cb9-941a-023f38452b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:48 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d508fac8-a4b0-4d27-b917-095a5f56cd25 tempest-GroupsTest-1713160931 None] Created volume successfully. Jul 03 13:51:48 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa002188-b097-4e87-997b-332f714d1609" returned: 0 in 0.708s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Lock "cinder-quobyte-aa002188-b097-4e87-997b-332f714d1609" released by "delete_volume" :: held 1.603s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:48 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-574a8399-bbb9-4804-91a5-5419f54a94dc tempest-GroupsTest-1713160931 None] Update group completed successfully. Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Created reservations ['1559c8b4-f523-4996-b6b1-66e8b3cac2f0', '16547a61-6bac-4636-a29c-ab109fb216d3', '8ccac81b-7998-4eda-80b0-de23bc8d66bb', '27110da0-9946-4c0e-b41a-59d271af6838'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:48 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:51:48 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:49 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.047s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:49 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Deleted volume successfully. Jul 03 13:51:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2a7e36e2-4f7d-449e-bd85-1ce2e57be478 tempest-VolumesCloneNegativeTest-2050951513 None] Lock "cinder-aa002188-b097-4e87-997b-332f714d1609-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-db9370b2-bb0d-4795-a67e-a7cf09c01f72 tempest-GroupsTest-1713160931 None] Update group completed successfully. Jul 03 13:51:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Acquiring lock "cinder-quobyte-d59447fa-2e33-4353-81d9-9681d4aa517e" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Lock "cinder-quobyte-d59447fa-2e33-4353-81d9-9681d4aa517e" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:52 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c374b77-38b9-4f88-bf9d-b8c9da91e724]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d59447fa-2e33-4353-81d9-9681d4aa517e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:52 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d59447fa-2e33-4353-81d9-9681d4aa517e Jul 03 13:51:52 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:53 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d59447fa-2e33-4353-81d9-9681d4aa517e" returned: 0 in 0.993s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d59447fa-2e33-4353-81d9-9681d4aa517e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:53 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d59447fa-2e33-4353-81d9-9681d4aa517e Jul 03 13:51:53 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:54 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d59447fa-2e33-4353-81d9-9681d4aa517e" returned: 0 in 0.811s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Lock "cinder-quobyte-d59447fa-2e33-4353-81d9-9681d4aa517e" released by "delete_volume" :: held 1.891s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Acquiring lock "cinder-quobyte-db265dee-3b98-4cca-8d8e-0b79463ab48d" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:51:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Lock "cinder-quobyte-db265dee-3b98-4cca-8d8e-0b79463ab48d" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:51:54 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cde0e1b-8235-4c42-a287-ededbcadbeb2]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:51:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-db265dee-3b98-4cca-8d8e-0b79463ab48d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:54 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-db265dee-3b98-4cca-8d8e-0b79463ab48d Jul 03 13:51:54 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:55 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-db265dee-3b98-4cca-8d8e-0b79463ab48d" returned: 0 in 1.192s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-db265dee-3b98-4cca-8d8e-0b79463ab48d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:55 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-db265dee-3b98-4cca-8d8e-0b79463ab48d Jul 03 13:51:55 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:56 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-db265dee-3b98-4cca-8d8e-0b79463ab48d" returned: 0 in 0.711s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Lock "cinder-quobyte-db265dee-3b98-4cca-8d8e-0b79463ab48d" released by "delete_volume" :: held 1.965s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Created reservations ['976ccfb5-90ad-4097-a57f-620f10834f49'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:51:56 devstack cinder-volume[86729]: WARNING cinder.quota [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1170357319 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1170357319, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:51:56 devstack cinder-volume[86729]: WARNING cinder.quota [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1170357319 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1170357319, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Created reservations ['5e98c2be-3df6-40ad-bc2f-b4d519c48c53', '542baa78-9916-401a-a280-6d3098855c18', 'bbb04441-52e8-484c-8d4f-6557bafe5ced', '024f28a6-2534-4fab-a138-1bafd753bd9c'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Created reservations ['7722667a-1f62-4af1-884e-0cc87ec3a188', '814ed86c-d289-4a9d-a71a-7f242c44d82d', 'd94164dc-772b-4909-837a-60a1aec579e2', '309fbad2-89b0-4ecf-9dc4-d3a7c9db9a7d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:56 devstack sudo[92793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:51:56 devstack sudo[92793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Flow 'volume_create_manager' (ddd02499-9b01-4a47-a4f9-c792e0fa62c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f379f4fc-2529-46cf-86fc-17c62c4a34fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f379f4fc-2529-46cf-86fc-17c62c4a34fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1010815992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812330b5-1041-4c23-ad37-cb28553b88a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb8566d71de4c8cbd35bcf79923533b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:57Z,use_quota=True,user_id='c17776a515234cf68cc4d7eb9ada994a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d4616a-afe1-41f8-914b-1fea63b82779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d4616a-afe1-41f8-914b-1fea63b82779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1abc574-5159-4efe-bb4d-cf426cde369e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1abc574-5159-4efe-bb4d-cf426cde369e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '812330b5-1041-4c23-ad37-cb28553b88a8', 'volume_name': 'volume-812330b5-1041-4c23-ad37-cb28553b88a8', 'volume_size': 2}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d359c218-7a05-428c-8867-d0ed33616bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d359c218-7a05-428c-8867-d0ed33616bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1f577c-aef3-4863-83df-f2fa05a30df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:56 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Volume 812330b5-1041-4c23-ad37-cb28553b88a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-812330b5-1041-4c23-ad37-cb28553b88a8', 'volume_size': 2} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1010815992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812330b5-1041-4c23-ad37-cb28553b88a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb8566d71de4c8cbd35bcf79923533b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:51:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:51:57Z,use_quota=True,user_id='c17776a515234cf68cc4d7eb9ada994a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Creating volume 812330b5-1041-4c23-ad37-cb28553b88a8 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:51:56 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:51:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 2147483648 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:57 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 2147483648 Jul 03 13:51:57 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:57 devstack sudo[92793]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.688s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:57 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:51:57 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-31446d7b-286c-4084-9023-16d55720b2ab tempest-GroupsTest-1713160931 None] Delete group completed successfully. Jul 03 13:51:58 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 2147483648" returned: 0 in 1.093s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:51:58 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 Jul 03 13:51:58 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:51:59 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Jul 03 13:51:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8" returned: 0 in 1.083s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:51:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:51:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:51:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1f577c-aef3-4863-83df-f2fa05a30df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-812330b5-1041-4c23-ad37-cb28553b88a8', 'volume_size': 2}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6130ae68-329f-46e0-b20a-48e1270da9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:51:59 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Volume volume-812330b5-1041-4c23-ad37-cb28553b88a8 (812330b5-1041-4c23-ad37-cb28553b88a8): created successfully Jul 03 13:51:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6130ae68-329f-46e0-b20a-48e1270da9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:51:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Flow 'volume_create_manager' (ddd02499-9b01-4a47-a4f9-c792e0fa62c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:51:59 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-92a2143f-e378-411c-a167-eec9f2a5540e tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Created volume successfully. Jul 03 13:52:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Creating offline snapshot 07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 of volume 812330b5-1041-4c23-ad37-cb28553b88a8 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:52:00 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bdacbb-27f9-43cf-a767-88f945e5a35a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:00 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 Jul 03 13:52:00 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:01 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8" returned: 0 in 1.349s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 2G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:01 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 2G Jul 03 13:52:01 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:03 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 2G" returned: 0 in 1.257s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-812330b5-1041-4c23-ad37-cb28553b88a8 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:03 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-812330b5-1041-4c23-ad37-cb28553b88a8 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 Jul 03 13:52:03 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:03 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-812330b5-1041-4c23-ad37-cb28553b88a8 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4" returned: 0 in 0.886s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:03 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 is being set with open permissions: ugo+rw Jul 03 13:52:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:03 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 Jul 03 13:52:03 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:04 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4" returned: 0 in 0.793s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:04 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.info Jul 03 13:52:04 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:05 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.info" returned: 0 in 0.776s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:05 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.info is being set with open permissions: ugo+rw Jul 03 13:52:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:05 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.info Jul 03 13:52:05 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:06 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.info" returned: 0 in 0.858s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.039s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:06 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-55e33f99-cef3-48ff-b5cd-29862527a40b tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Create snapshot completed successfully Jul 03 13:52:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Acquiring lock "cinder-07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "cinder-07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Acquiring lock "cinder-quobyte-812330b5-1041-4c23-ad37-cb28553b88a8" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "cinder-quobyte-812330b5-1041-4c23-ad37-cb28553b88a8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Acquiring lock "cinder-quobyte-07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "cinder-quobyte-07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Deleting offline snapshot 07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 of volume 812330b5-1041-4c23-ad37-cb28553b88a8 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:52:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] snapshot_file for this snap is: volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:52:07 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f84b9f-074a-46ee-93a8-ba2bfdc90f04]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:07 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 Jul 03 13:52:07 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:07 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-f9c3e17e-a9d6-47fa-9560-18e5434670e8 req-6647f0fe-d969-49c0-8533-bb761eac1f13 tempest-ServerActionsTestOtherA-1902105871 None] Terminate volume connection completed successfully. Jul 03 13:52:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f9c3e17e-a9d6-47fa-9560-18e5434670e8 req-6647f0fe-d969-49c0-8533-bb761eac1f13 tempest-ServerActionsTestOtherA-1902105871 None] Deleting attachment 41a09acb-d8bb-4a9a-88c9-241564e6495c. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:52:08 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4" returned: 0 in 1.168s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-812330b5-1041-4c23-ad37-cb28553b88a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:52:08 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[0260e517-5622-4cb0-b857-e4c0bb3e0d50]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:08 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 Jul 03 13:52:08 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:09 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8" returned: 0 in 0.837s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:09 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 Jul 03 13:52:09 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:10 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4" returned: 0 in 0.966s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:10 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4 Jul 03 13:52:10 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:10 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8.07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4" returned: 0 in 0.669s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "cinder-quobyte-07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4" released by "_delete_snapshot" :: held 3.854s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "cinder-quobyte-812330b5-1041-4c23-ad37-cb28553b88a8" released by "delete_snapshot" :: held 3.884s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:10 devstack cinder-volume[86729]: WARNING cinder.quota [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:52:10 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Created reservations ['1af71d5a-058a-47aa-b17b-7609660f6f1e', 'e4749d2f-76b9-4d56-95d5-00dfd5f8e89d', '61d9dba4-dcba-4334-9260-1eb5dbe519ed', '7151d52e-01b0-4b0b-b61b-76729a0ed1e4'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:52:11 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Delete snapshot completed successfully. Jul 03 13:52:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2355af62-a24d-4c35-8333-a43e163ff974 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "cinder-07f7f74d-d2ea-478a-ba1b-b6dbd5c897e4-delete_snapshot" released by "delete_snapshot" :: held 4.200s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Acquiring lock "cinder-812330b5-1041-4c23-ad37-cb28553b88a8-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "cinder-812330b5-1041-4c23-ad37-cb28553b88a8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Acquiring lock "cinder-quobyte-812330b5-1041-4c23-ad37-cb28553b88a8" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "cinder-quobyte-812330b5-1041-4c23-ad37-cb28553b88a8" acquired by "delete_volume" :: waited 0.043s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:11 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e623541-7107-47fe-a31f-aa33e2864cda]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:11 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 Jul 03 13:52:11 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:12 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8" returned: 0 in 0.959s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:12 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8 Jul 03 13:52:12 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Flow 'volume_create_manager' (ae0fc28e-f990-4903-a510-e2638f7e5fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5288dc-6115-408e-ac14-a1ec5cd474e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5288dc-6115-408e-ac14-a1ec5cd474e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1808028307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56a0b83-bb27-4e40-96d2-a62a75dbf8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecad94363e9b4503b13ffd33a509fa20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:52:13Z,use_quota=True,user_id='f97859cebdf84020b8f40b5a5cf8affe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5c912d-f308-47a2-9420-451f1b186772),volume_type_id=ab5c912d-f308-47a2-9420-451f1b186772)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b7ed1e-62aa-424a-a923-0f317d985f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b7ed1e-62aa-424a-a923-0f317d985f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142ed4fb-a4de-4218-ad1e-6d906194a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142ed4fb-a4de-4218-ad1e-6d906194a97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a56a0b83-bb27-4e40-96d2-a62a75dbf8ca', 'volume_name': 'volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e986ce5f-5fec-4c16-b554-77fc23b7dbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e986ce5f-5fec-4c16-b554-77fc23b7dbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68d5531-616d-40fd-8976-d53216e1178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:12 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Volume a56a0b83-bb27-4e40-96d2-a62a75dbf8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca', 'volume_size': 1} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1808028307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56a0b83-bb27-4e40-96d2-a62a75dbf8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecad94363e9b4503b13ffd33a509fa20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:52:13Z,use_quota=True,user_id='f97859cebdf84020b8f40b5a5cf8affe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5c912d-f308-47a2-9420-451f1b186772),volume_type_id=ab5c912d-f308-47a2-9420-451f1b186772)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Creating volume a56a0b83-bb27-4e40-96d2-a62a75dbf8ca {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:52:12 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:52:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:12 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca 1073741824 Jul 03 13:52:12 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:13 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-812330b5-1041-4c23-ad37-cb28553b88a8" returned: 0 in 0.792s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "cinder-quobyte-812330b5-1041-4c23-ad37-cb28553b88a8" released by "delete_volume" :: held 1.903s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:13 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Created reservations ['524fb4e3-530a-4ea6-86b4-68025f613ee4', 'f5aefefe-d51f-464f-8a14-1c3d1a6c5727', '097ed2a2-c0a2-44f6-bed6-cc2a1a427f0a', 'e85fa95e-684f-4b49-a7f1-2e36acca2e6a'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:52:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:13 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:52:13 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:13 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca 1073741824" returned: 0 in 0.964s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:13 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca Jul 03 13:52:13 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:14 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.727s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:52:14 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Deleted volume successfully. Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a7e19a0f-c6d6-4662-aa40-2d6e61b37a24 tempest-VolumesSnapshotNegativeTestJSON-1095200517 None] Lock "cinder-812330b5-1041-4c23-ad37-cb28553b88a8-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:14 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca" returned: 0 in 0.693s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68d5531-616d-40fd-8976-d53216e1178a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75a0940-24e1-4242-bf77-a7eb329166fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:14 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Volume volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca (a56a0b83-bb27-4e40-96d2-a62a75dbf8ca): created successfully Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75a0940-24e1-4242-bf77-a7eb329166fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Flow 'volume_create_manager' (ae0fc28e-f990-4903-a510-e2638f7e5fba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:52:14 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-14474648-af69-4752-b1d4-62cf18a0d463 tempest-VolumeTypesAccessTest-202241195 None] Created volume successfully. Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Acquiring lock "cinder-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Lock "cinder-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Acquiring lock "cinder-quobyte-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Lock "cinder-quobyte-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:15 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c7b55a-b0ad-4f11-a2d2-2af2577040c5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:15 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca Jul 03 13:52:15 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:15 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca" returned: 0 in 0.848s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:15 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca Jul 03 13:52:15 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:16 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca" returned: 0 in 0.728s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Lock "cinder-quobyte-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca" released by "delete_volume" :: held 1.626s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:16 devstack cinder-volume[86729]: WARNING cinder.quota [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1765541587 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1765541587, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:52:16 devstack cinder-volume[86729]: WARNING cinder.quota [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1765541587 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1765541587, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:52:16 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Created reservations ['0981aa41-27ec-457c-b66a-a020cfd7ed4d', '633f9cae-8832-4bac-ae59-4164778c78b4', '2fd2a0e8-ead9-4a84-b610-1fa934107789', '0304ae10-cbc1-4c69-9a66-73c5f8be41af'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:52:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:16 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:52:16 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:17 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.692s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:17 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:52:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Deleted volume successfully. Jul 03 13:52:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b66cc26b-2d97-4753-80d8-1c73b7adf10b tempest-VolumeTypesAccessTest-202241195 None] Lock "cinder-a56a0b83-bb27-4e40-96d2-a62a75dbf8ca-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Acquiring lock "cinder-61060803-de86-4953-90d8-09dbd2ca2ae7-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Lock "cinder-61060803-de86-4953-90d8-09dbd2ca2ae7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Acquiring lock "cinder-quobyte-61060803-de86-4953-90d8-09dbd2ca2ae7" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Lock "cinder-quobyte-61060803-de86-4953-90d8-09dbd2ca2ae7" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:18 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc5cbdb-ec7e-4dfb-b1c8-61fd26b2c8df]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:18 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 Jul 03 13:52:18 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:19 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7" returned: 0 in 0.841s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:19 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7 Jul 03 13:52:19 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-61060803-de86-4953-90d8-09dbd2ca2ae7" returned: 0 in 0.996s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:20 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Lock "cinder-quobyte-61060803-de86-4953-90d8-09dbd2ca2ae7" released by "delete_volume" :: held 1.909s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:20 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Created reservations ['8b8eedf1-3ad4-40ae-82c6-e648e8577db0', '181537ce-7b88-4604-8284-91fa6629031a', 'f2d582f1-ff53-40f4-8fe8-a71282183114', '3b12b554-513d-43d9-b7e4-c99be02eb896'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:52:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:20 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:52:20 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:21 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.013s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:21 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:52:21 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Deleted volume successfully. Jul 03 13:52:21 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0ba04d1d-5edd-4913-98d5-014b779693a8 tempest-ServerActionsTestOtherA-1902105871 None] Lock "cinder-61060803-de86-4953-90d8-09dbd2ca2ae7-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Flow 'volume_create_manager' (aab96afc-a22c-4e5c-bf26-890f9cf47cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91b8edd-b601-4de1-bab4-b8a069c2d7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91b8edd-b601-4de1-bab4-b8a069c2d7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1573324143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a036267-6519-4e13-af20-80679ce5c5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b3a6b8556f4c1eb2bbaec25acf21e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:52:24Z,use_quota=True,user_id='bb3b75dc732b48bd97891aa43fcc529c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f75c8d-0235-4f61-955b-89a420f36be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f75c8d-0235-4f61-955b-89a420f36be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1bff28-96d8-4dad-ac7a-5ac603c78376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1bff28-96d8-4dad-ac7a-5ac603c78376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a036267-6519-4e13-af20-80679ce5c5c2', 'volume_name': 'volume-2a036267-6519-4e13-af20-80679ce5c5c2', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b2a4b5-e87e-40aa-baeb-b5545ae9e49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b2a4b5-e87e-40aa-baeb-b5545ae9e49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61e1710-bb6b-474a-86ef-bffd7a431305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:23 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Volume 2a036267-6519-4e13-af20-80679ce5c5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a036267-6519-4e13-af20-80679ce5c5c2', 'volume_size': 1} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1573324143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a036267-6519-4e13-af20-80679ce5c5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b3a6b8556f4c1eb2bbaec25acf21e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:52:24Z,use_quota=True,user_id='bb3b75dc732b48bd97891aa43fcc529c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Creating volume 2a036267-6519-4e13-af20-80679ce5c5c2 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:52:23 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:52:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:23 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2 1073741824 Jul 03 13:52:23 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:25 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2 1073741824" returned: 0 in 1.237s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:25 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2 Jul 03 13:52:25 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:52:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:25 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:52:25 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:52:25 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Flow 'volume_create_manager' (a8db83bd-b4ed-4363-93a0-f16b2ed064be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:52:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634afabe-cbd1-47d6-85f9-3c68bab7bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634afabe-cbd1-47d6-85f9-3c68bab7bda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-276909971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75245c80-e59b-4383-b255-ae8b5af860a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb267a147ce141a9ba0ed36be22a0cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:52:26Z,use_quota=True,user_id='81c46ed945f34fb0a8451d9da067d922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ba63e7-dd6d-425b-a6cf-540afa02dbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ba63e7-dd6d-425b-a6cf-540afa02dbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f862f7e0-bc44-4938-81ce-78fdd6dd7aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:26 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f862f7e0-bc44-4938-81ce-78fdd6dd7aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75245c80-e59b-4383-b255-ae8b5af860a1', 'volume_name': 'volume-75245c80-e59b-4383-b255-ae8b5af860a1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb677e2-ccb7-41a2-9d1a-84b20dc6d454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb677e2-ccb7-41a2-9d1a-84b20dc6d454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f4c391-5b45-4217-9ff7-e4d9216cdea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:26 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Volume 75245c80-e59b-4383-b255-ae8b5af860a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75245c80-e59b-4383-b255-ae8b5af860a1', 'volume_size': 1} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2" returned: 0 in 0.897s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.225s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-276909971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75245c80-e59b-4383-b255-ae8b5af860a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb267a147ce141a9ba0ed36be22a0cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:52:26Z,use_quota=True,user_id='81c46ed945f34fb0a8451d9da067d922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Creating volume 75245c80-e59b-4383-b255-ae8b5af860a1 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:52:26 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61e1710-bb6b-474a-86ef-bffd7a431305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a036267-6519-4e13-af20-80679ce5c5c2', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656d356c-0776-4b24-b21e-716e9c7d134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:26 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 1073741824 Jul 03 13:52:26 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:26 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Volume volume-2a036267-6519-4e13-af20-80679ce5c5c2 (2a036267-6519-4e13-af20-80679ce5c5c2): created successfully Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656d356c-0776-4b24-b21e-716e9c7d134c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Flow 'volume_create_manager' (aab96afc-a22c-4e5c-bf26-890f9cf47cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:52:26 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ecc730b4-b962-4049-a2ff-68cd738be732 tempest-AttachVolumeTestJSON-25329155 None] Created volume successfully. Jul 03 13:52:26 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.992s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:52:27 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 1073741824" returned: 0 in 1.236s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:27 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 Jul 03 13:52:27 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:28 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1" returned: 0 in 0.729s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:52:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f4c391-5b45-4217-9ff7-e4d9216cdea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75245c80-e59b-4383-b255-ae8b5af860a1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a288aab0-88e6-45ba-aae0-cc1ef5cd4e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:28 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Volume volume-75245c80-e59b-4383-b255-ae8b5af860a1 (75245c80-e59b-4383-b255-ae8b5af860a1): created successfully Jul 03 13:52:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a288aab0-88e6-45ba-aae0-cc1ef5cd4e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Flow 'volume_create_manager' (a8db83bd-b4ed-4363-93a0-f16b2ed064be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:52:28 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-cc6b6b4e-d4e7-465d-845b-8558e86eefbf tempest-SnapshotMetadataTestJSON-2117515860 None] Created volume successfully. Jul 03 13:52:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] Creating offline snapshot 9de769cb-7c4b-474e-a364-185941cc1fa1 of volume 75245c80-e59b-4383-b255-ae8b5af860a1 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:52:29 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39e8f31-1b80-4e23-9ad0-821d7f8e7a81]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:29 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 Jul 03 13:52:29 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:30 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1" returned: 0 in 0.980s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-0545df40-8775-462e-a1a2-31b6e3e2e69d req-37f86008-33cf-4cc2-9123-5eab1d45faf4 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:30 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 1G Jul 03 13:52:30 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:31 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 1G" returned: 0 in 0.979s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75245c80-e59b-4383-b255-ae8b5af860a1 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:31 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75245c80-e59b-4383-b255-ae8b5af860a1 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 Jul 03 13:52:31 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:32 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75245c80-e59b-4383-b255-ae8b5af860a1 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1" returned: 0 in 0.823s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:32 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 is being set with open permissions: ugo+rw Jul 03 13:52:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:32 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 Jul 03 13:52:32 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:32 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1" returned: 0 in 0.737s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:33 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.info Jul 03 13:52:33 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:33 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.info" returned: 0 in 0.850s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:33 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.info is being set with open permissions: ugo+rw Jul 03 13:52:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:33 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.info Jul 03 13:52:33 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:34 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.info" returned: 0 in 0.804s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.292s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-0545df40-8775-462e-a1a2-31b6e3e2e69d req-37f86008-33cf-4cc2-9123-5eab1d45faf4 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.244s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:34 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c576f8b-77e8-4538-9ae3-ff3a19ea7fa6]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-689a6c0a-ac23-4234-8036-1d2e0ea1464e tempest-SnapshotMetadataTestJSON-2117515860 None] Create snapshot completed successfully Jul 03 13:52:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-0545df40-8775-462e-a1a2-31b6e3e2e69d req-37f86008-33cf-4cc2-9123-5eab1d45faf4 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:34 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2 Jul 03 13:52:34 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:35 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-0545df40-8775-462e-a1a2-31b6e3e2e69d req-37f86008-33cf-4cc2-9123-5eab1d45faf4 tempest-AttachVolumeTestJSON-25329155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2" returned: 0 in 0.895s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-0545df40-8775-462e-a1a2-31b6e3e2e69d req-37f86008-33cf-4cc2-9123-5eab1d45faf4 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.938s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:35 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-0545df40-8775-462e-a1a2-31b6e3e2e69d req-37f86008-33cf-4cc2-9123-5eab1d45faf4 tempest-AttachVolumeTestJSON-25329155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-2a036267-6519-4e13-af20-80679ce5c5c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fdd56b24-1889-4022-9660-e2f65428213b', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:52:35 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-0545df40-8775-462e-a1a2-31b6e3e2e69d req-37f86008-33cf-4cc2-9123-5eab1d45faf4 tempest-AttachVolumeTestJSON-25329155 None] attachment_update completed successfully. Jul 03 13:52:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Acquiring lock "cinder-9de769cb-7c4b-474e-a364-185941cc1fa1-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "cinder-9de769cb-7c4b-474e-a364-185941cc1fa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Acquiring lock "cinder-quobyte-75245c80-e59b-4383-b255-ae8b5af860a1" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "cinder-quobyte-75245c80-e59b-4383-b255-ae8b5af860a1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Acquiring lock "cinder-quobyte-9de769cb-7c4b-474e-a364-185941cc1fa1" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "cinder-quobyte-9de769cb-7c4b-474e-a364-185941cc1fa1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Deleting offline snapshot 9de769cb-7c4b-474e-a364-185941cc1fa1 of volume 75245c80-e59b-4383-b255-ae8b5af860a1 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:52:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] snapshot_file for this snap is: volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:52:36 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e35565-86a3-40fb-9c2d-bc3761bfeb75]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:36 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 Jul 03 13:52:36 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:37 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1" returned: 0 in 1.167s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75245c80-e59b-4383-b255-ae8b5af860a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:52:37 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f7ee5d-0de5-42d5-91d3-a21c28d8df9f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:38 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 Jul 03 13:52:38 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Flow 'volume_create_manager' (83af4361-e120-4c16-895c-c01cb392c5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ebde7e-262f-4ff9-886d-5abca266f178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ebde7e-262f-4ff9-886d-5abca266f178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-502695450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76c87d7-b6ce-449b-817d-a2ec971b1395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de432e2d0c24c72b91e156f0cb184f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:52:39Z,use_quota=True,user_id='812e9fdf153849729dfe04a10414011c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7e4cd9-767c-4221-9d8a-fe032dd91d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7e4cd9-767c-4221-9d8a-fe032dd91d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d37cce6-ace7-4af8-b806-7bdb528da41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d37cce6-ace7-4af8-b806-7bdb528da41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd76c87d7-b6ce-449b-817d-a2ec971b1395', 'volume_name': 'volume-d76c87d7-b6ce-449b-817d-a2ec971b1395', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b56450-135d-421c-a041-c1f0987b2d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b56450-135d-421c-a041-c1f0987b2d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7cc34c-2de8-4ad7-b0d4-9f300f90068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:38 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Volume d76c87d7-b6ce-449b-817d-a2ec971b1395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d76c87d7-b6ce-449b-817d-a2ec971b1395', 'volume_size': 1} Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-502695450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76c87d7-b6ce-449b-817d-a2ec971b1395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de432e2d0c24c72b91e156f0cb184f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:52:39Z,use_quota=True,user_id='812e9fdf153849729dfe04a10414011c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:52:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Creating volume d76c87d7-b6ce-449b-817d-a2ec971b1395 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:52:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:52:39 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:52:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:39 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1" returned: 0 in 1.089s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:39 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 1073741824 Jul 03 13:52:39 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:39 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 Jul 03 13:52:39 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:40 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1" returned: 0 in 1.113s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:40 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1 Jul 03 13:52:40 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:40 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 1073741824" returned: 0 in 1.204s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:40 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 Jul 03 13:52:40 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:41 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1.9de769cb-7c4b-474e-a364-185941cc1fa1" returned: 0 in 0.911s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "cinder-quobyte-9de769cb-7c4b-474e-a364-185941cc1fa1" released by "_delete_snapshot" :: held 4.459s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:41 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395" returned: 0 in 0.887s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:52:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "cinder-quobyte-75245c80-e59b-4383-b255-ae8b5af860a1" released by "delete_snapshot" :: held 4.491s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7cc34c-2de8-4ad7-b0d4-9f300f90068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76c87d7-b6ce-449b-817d-a2ec971b1395', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d7f65d-d291-4fb1-bc7d-8ec4cb84f39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:41 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Volume volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 (d76c87d7-b6ce-449b-817d-a2ec971b1395): created successfully Jul 03 13:52:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d7f65d-d291-4fb1-bc7d-8ec4cb84f39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Flow 'volume_create_manager' (83af4361-e120-4c16-895c-c01cb392c5e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:52:41 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-d4eacc85-ea38-479a-9cbe-77e00f77e183 req-d8241be0-ed6d-4afc-80cc-3de3c8dba0bb tempest-VolumesSnapshotsTestJSON-1858985889 None] Created volume successfully. Jul 03 13:52:41 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Created reservations ['bcae801f-3205-4d60-be56-bb385585035a', 'ab68c6e1-3ea9-438a-aeb1-a0ae0c8899f0', 'bb0e47a9-ee55-46be-b712-0be00f58250e', 'f9e2a3d4-fa17-4db2-9957-15d1e2c86169'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:52:41 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Delete snapshot completed successfully. Jul 03 13:52:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fdf63157-6829-4ea5-af93-ea937674f99f tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "cinder-9de769cb-7c4b-474e-a364-185941cc1fa1-delete_snapshot" released by "delete_snapshot" :: held 4.697s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Acquiring lock "cinder-75245c80-e59b-4383-b255-ae8b5af860a1-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "cinder-75245c80-e59b-4383-b255-ae8b5af860a1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Acquiring lock "cinder-quobyte-75245c80-e59b-4383-b255-ae8b5af860a1" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "cinder-quobyte-75245c80-e59b-4383-b255-ae8b5af860a1" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:42 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6695669-3071-4285-a298-32e7c768ac8d]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:42 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 Jul 03 13:52:42 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:42 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=77,cinder:INSERT=25,cinder:UPDATE=86,cinder:DELETE=4 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:52:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:42 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] Creating offline snapshot 13a28a07-c6ee-4ccd-a528-765567393f21 of volume d76c87d7-b6ce-449b-817d-a2ec971b1395 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:52:42 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15ce5c1-2077-4a77-820e-be86dc59ec0e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:43 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 Jul 03 13:52:43 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:43 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1" returned: 0 in 1.238s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:43 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1 Jul 03 13:52:43 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:43 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395" returned: 0 in 1.080s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:43 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 1G Jul 03 13:52:43 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:44 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-75245c80-e59b-4383-b255-ae8b5af860a1" returned: 0 in 0.802s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "cinder-quobyte-75245c80-e59b-4383-b255-ae8b5af860a1" released by "delete_volume" :: held 2.134s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:44 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=98,cinder:DELETE=10,cinder:SELECT=83,cinder:INSERT=18 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:52:44 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Created reservations ['23d2c452-0551-4f69-8496-3edc59df770d', '7ee2548e-ce27-455e-b9d2-0aee3e9e6aee', 'cbd56ddb-190b-454a-af32-3f07f4f23827', 'e1144e30-c620-4c52-9279-a04aa54da338'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:52:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:44 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:52:44 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:45 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 1G" returned: 0 in 1.134s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:45 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 Jul 03 13:52:45 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:45 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.697s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:45 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:52:45 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Deleted volume successfully. Jul 03 13:52:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-90a6db16-a1a2-4199-b16c-411af9a5055f tempest-SnapshotMetadataTestJSON-2117515860 None] Lock "cinder-75245c80-e59b-4383-b255-ae8b5af860a1-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:45 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21" returned: 0 in 0.756s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:45 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 is being set with open permissions: ugo+rw Jul 03 13:52:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:45 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 Jul 03 13:52:45 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:46 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21" returned: 0 in 0.688s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:46 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.info Jul 03 13:52:46 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:47 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.info" returned: 0 in 0.876s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:47 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.info is being set with open permissions: ugo+rw Jul 03 13:52:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:47 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.info Jul 03 13:52:47 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:48 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.info" returned: 0 in 0.878s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.593s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:48 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-f41ced47-b876-45de-94df-eabf7495f973 req-ad44b412-9f23-405d-945c-33151b1ef111 tempest-VolumesSnapshotsTestJSON-1858985889 None] Create snapshot completed successfully Jul 03 13:52:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Acquiring lock "cinder-13a28a07-c6ee-4ccd-a528-765567393f21-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "cinder-13a28a07-c6ee-4ccd-a528-765567393f21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Acquiring lock "cinder-quobyte-d76c87d7-b6ce-449b-817d-a2ec971b1395" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "cinder-quobyte-d76c87d7-b6ce-449b-817d-a2ec971b1395" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Acquiring lock "cinder-quobyte-13a28a07-c6ee-4ccd-a528-765567393f21" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "cinder-quobyte-13a28a07-c6ee-4ccd-a528-765567393f21" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Deleting offline snapshot 13a28a07-c6ee-4ccd-a528-765567393f21 of volume d76c87d7-b6ce-449b-817d-a2ec971b1395 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:52:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] snapshot_file for this snap is: volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:52:49 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1184ad20-cc04-41df-89c6-a8ec632a3f89]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:49 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 Jul 03 13:52:49 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:49 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21" returned: 0 in 0.875s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d76c87d7-b6ce-449b-817d-a2ec971b1395(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:52:49 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db15cfb-56aa-47a4-ad6a-6fde0f256cd8]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:50 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 Jul 03 13:52:50 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Flow 'volume_create_manager' (3a655251-5013-4c01-9b99-23c94e5b34d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:52:50 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f84384b-d9ac-48af-8b29-8d3b9c808f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395" returned: 0 in 0.835s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f84384b-d9ac-48af-8b29-8d3b9c808f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1388722208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e6df23-dc08-4356-9056-a1f1dc5096a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a13336dc8da4e4fbc4b1e592b4fd396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:52:51Z,use_quota=True,user_id='3a271faf918048f99c3fe56b2512db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:50 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 Jul 03 13:52:50 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3b29f6-9e4b-4162-badf-ee718a4b6e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3b29f6-9e4b-4162-badf-ee718a4b6e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c3075f-cbe8-4aa6-a72a-043d87946c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c3075f-cbe8-4aa6-a72a-043d87946c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e6df23-dc08-4356-9056-a1f1dc5096a9', 'volume_name': 'volume-82e6df23-dc08-4356-9056-a1f1dc5096a9', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960980d0-0812-469b-a539-03f91f8e0dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960980d0-0812-469b-a539-03f91f8e0dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f9382d-78bd-4cd5-9d93-62c19a887abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:50 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Volume 82e6df23-dc08-4356-9056-a1f1dc5096a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e6df23-dc08-4356-9056-a1f1dc5096a9', 'volume_size': 1} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1388722208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e6df23-dc08-4356-9056-a1f1dc5096a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a13336dc8da4e4fbc4b1e592b4fd396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:52:51Z,use_quota=True,user_id='3a271faf918048f99c3fe56b2512db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Creating volume 82e6df23-dc08-4356-9056-a1f1dc5096a9 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:52:50 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:52:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-82e6df23-dc08-4356-9056-a1f1dc5096a9 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:50 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-82e6df23-dc08-4356-9056-a1f1dc5096a9 1073741824 Jul 03 13:52:50 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:51 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21" returned: 0 in 0.816s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:51 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21 Jul 03 13:52:51 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:51 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-82e6df23-dc08-4356-9056-a1f1dc5096a9 1073741824" returned: 0 in 0.877s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-82e6df23-dc08-4356-9056-a1f1dc5096a9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:51 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-82e6df23-dc08-4356-9056-a1f1dc5096a9 Jul 03 13:52:51 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:52 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395.13a28a07-c6ee-4ccd-a528-765567393f21" returned: 0 in 0.680s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "cinder-quobyte-13a28a07-c6ee-4ccd-a528-765567393f21" released by "_delete_snapshot" :: held 3.374s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "cinder-quobyte-d76c87d7-b6ce-449b-817d-a2ec971b1395" released by "delete_snapshot" :: held 3.399s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:52 devstack cinder-volume[86729]: DEBUG cinder.quota [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Created reservations ['cfdb7001-5252-4653-ada6-115c6de4da16', '1fa45082-f556-4493-9473-def5eb8ccc4a', '59ba4702-974e-49fe-9ddc-1f29f9740a6f', '8f94416d-c6c7-46d1-a549-c384581c4912'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:52:52 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-82e6df23-dc08-4356-9056-a1f1dc5096a9" returned: 0 in 0.710s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:52 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:52:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f9382d-78bd-4cd5-9d93-62c19a887abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e6df23-dc08-4356-9056-a1f1dc5096a9', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42fb53b-c51e-4c40-a286-d0d3b772c743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:52:52 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Volume volume-82e6df23-dc08-4356-9056-a1f1dc5096a9 (82e6df23-dc08-4356-9056-a1f1dc5096a9): created successfully Jul 03 13:52:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42fb53b-c51e-4c40-a286-d0d3b772c743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:52:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Flow 'volume_create_manager' (3a655251-5013-4c01-9b99-23c94e5b34d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:52:52 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Delete snapshot completed successfully. Jul 03 13:52:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-cef1a898-ec49-4c15-ae1f-ba7fa060ad32 req-fa7893f1-db3d-46a0-a057-78b536bfdec5 tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "cinder-13a28a07-c6ee-4ccd-a528-765567393f21-delete_snapshot" released by "delete_snapshot" :: held 3.620s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:52 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-aa6dbe15-b290-455a-936c-ab4f03b18d21 tempest-VolumesTransfersV355Test-957284235 None] Created volume successfully. Jul 03 13:52:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Acquiring lock "cinder-d76c87d7-b6ce-449b-817d-a2ec971b1395-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "cinder-d76c87d7-b6ce-449b-817d-a2ec971b1395-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Acquiring lock "cinder-quobyte-d76c87d7-b6ce-449b-817d-a2ec971b1395" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "cinder-quobyte-d76c87d7-b6ce-449b-817d-a2ec971b1395" acquired by "delete_volume" :: waited 0.039s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:53 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b8b914c0-a4ca-478b-a93a-891c1d2a6edc tempest-VolumesTransfersV355Test-1892760130 None] Transfer volume completed successfully. Jul 03 13:52:53 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9214d0-5727-4e60-972f-fffed573e776]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:54 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 Jul 03 13:52:54 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Acquiring lock "cinder-82e6df23-dc08-4356-9056-a1f1dc5096a9-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Lock "cinder-82e6df23-dc08-4356-9056-a1f1dc5096a9-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Acquiring lock "cinder-quobyte-82e6df23-dc08-4356-9056-a1f1dc5096a9" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:52:55 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395" returned: 0 in 1.834s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Lock "cinder-quobyte-82e6df23-dc08-4356-9056-a1f1dc5096a9" acquired by "delete_volume" :: waited 0.048s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:52:55 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395 Jul 03 13:52:55 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[78333fd4-3951-440b-a35e-2b5f8c19d571]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:52:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-82e6df23-dc08-4356-9056-a1f1dc5096a9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:56 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-82e6df23-dc08-4356-9056-a1f1dc5096a9 Jul 03 13:52:56 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:56 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d76c87d7-b6ce-449b-817d-a2ec971b1395" returned: 0 in 1.207s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "cinder-quobyte-d76c87d7-b6ce-449b-817d-a2ec971b1395" released by "delete_volume" :: held 3.163s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:57 devstack cinder-volume[86729]: DEBUG cinder.quota [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Created reservations ['322fbef5-ca1b-4d39-8726-ae0838ebe8bf', '300b7e6b-3a5f-4d39-b0a9-158275c8bd5c', 'c9beee91-9e10-42f5-ac04-cc9fe82c87e5', '7c18270a-a154-4cca-9975-29a251a380bb'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:52:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:57 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:52:57 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:57 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-82e6df23-dc08-4356-9056-a1f1dc5096a9" returned: 0 in 1.669s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-82e6df23-dc08-4356-9056-a1f1dc5096a9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:57 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-82e6df23-dc08-4356-9056-a1f1dc5096a9 Jul 03 13:52:57 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:52:58 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.135s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:58 devstack cinder-volume[86729]: DEBUG cinder.manager [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:52:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Deleted volume successfully. Jul 03 13:52:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-5b2cad92-c8a0-4837-9ece-f62879412a66 req-c182ba71-4eb7-4c94-ae8d-954a335f5c0a tempest-VolumesSnapshotsTestJSON-1858985889 None] Lock "cinder-d76c87d7-b6ce-449b-817d-a2ec971b1395-delete_volume" released by "delete_volume" :: held 4.786s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:58 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Jul 03 13:52:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-82e6df23-dc08-4356-9056-a1f1dc5096a9" returned: 0 in 1.379s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:52:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Lock "cinder-quobyte-82e6df23-dc08-4356-9056-a1f1dc5096a9" released by "delete_volume" :: held 3.154s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:52:59 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Created reservations ['c8410126-8676-4b7f-91d5-dd62a750316f', 'b103a2ee-9624-4ff6-957c-8aeed3834501', '2da67ab7-8854-439b-a74c-e214783e2fc4', '324d809c-088d-4c85-851f-399b41394fda'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:52:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:52:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:52:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:52:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:52:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:52:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:52:59 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:52:59 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:00 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.969s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:53:00 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Deleted volume successfully. Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-20d1b4b8-d4d8-451c-8a80-932ef79f5e92 tempest-VolumesTransfersV355Test-230890496 None] Lock "cinder-82e6df23-dc08-4356-9056-a1f1dc5096a9-delete_volume" released by "delete_volume" :: held 4.563s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Flow 'volume_create_manager' (2d0b9817-b8a5-46ce-a08c-72b76c38a03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c250ad-126b-4c09-9966-59728782a786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c250ad-126b-4c09-9966-59728782a786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-807065779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51df94ad-536b-4c52-89a1-0be9a4e8c0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a13336dc8da4e4fbc4b1e592b4fd396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:01Z,use_quota=True,user_id='3a271faf918048f99c3fe56b2512db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8816d5b-347c-48e6-9edf-e093a23e50a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8816d5b-347c-48e6-9edf-e093a23e50a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca637dc-daea-4a78-9ab1-c48c4fd4f196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca637dc-daea-4a78-9ab1-c48c4fd4f196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51df94ad-536b-4c52-89a1-0be9a4e8c0a1', 'volume_name': 'volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f84820d-4f13-4edd-ae92-379a95182463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f84820d-4f13-4edd-ae92-379a95182463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc06b57-ba83-4724-89ee-4dacee5b0e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:00 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Volume 51df94ad-536b-4c52-89a1-0be9a4e8c0a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1', 'volume_size': 1} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-807065779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51df94ad-536b-4c52-89a1-0be9a4e8c0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a13336dc8da4e4fbc4b1e592b4fd396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:01Z,use_quota=True,user_id='3a271faf918048f99c3fe56b2512db11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Creating volume 51df94ad-536b-4c52-89a1-0be9a4e8c0a1 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:53:00 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:53:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:00 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1 1073741824 Jul 03 13:53:00 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:02 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1 1073741824" returned: 0 in 1.921s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:02 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1 Jul 03 13:53:02 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:03 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1" returned: 0 in 0.815s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] <== create_volume: return (2799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:53:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.802s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc06b57-ba83-4724-89ee-4dacee5b0e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1697d195-a443-4343-98ac-9a2192138617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:03 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Volume volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1 (51df94ad-536b-4c52-89a1-0be9a4e8c0a1): created successfully Jul 03 13:53:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1697d195-a443-4343-98ac-9a2192138617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Flow 'volume_create_manager' (2d0b9817-b8a5-46ce-a08c-72b76c38a03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:03 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-959c6c9f-b56b-4572-a9fc-d00281e1bd41 tempest-VolumesTransfersV355Test-957284235 None] Created volume successfully. Jul 03 13:53:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57e6bc29-6e82-45a6-bd7a-053ceb05def7 tempest-BackendsCapabilitiesAdminTestsJSON-1131462063 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86729) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 13:53:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Acquiring lock "cinder-51df94ad-536b-4c52-89a1-0be9a4e8c0a1-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:53:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Lock "cinder-51df94ad-536b-4c52-89a1-0be9a4e8c0a1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:53:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Acquiring lock "cinder-quobyte-51df94ad-536b-4c52-89a1-0be9a4e8c0a1" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:53:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Lock "cinder-quobyte-51df94ad-536b-4c52-89a1-0be9a4e8c0a1" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:53:04 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13ca1a0-1e58-494a-a6b6-39e0fd2c8343]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:04 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1 Jul 03 13:53:04 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a3e51a3f-9222-4ade-aac9-1851294a842e tempest-BackendsCapabilitiesAdminTestsJSON-1131462063 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86729) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 13:53:05 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1" returned: 0 in 0.915s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:05 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1 Jul 03 13:53:05 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:07 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-51df94ad-536b-4c52-89a1-0be9a4e8c0a1" returned: 0 in 1.437s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Lock "cinder-quobyte-51df94ad-536b-4c52-89a1-0be9a4e8c0a1" released by "delete_volume" :: held 2.431s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:53:07 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Created reservations ['fc1438ca-9be6-4854-847f-9e70b184d9d0', '0a96e25a-6e93-44d1-ab70-433fc3b92530', '72c133c8-7bb7-495e-8b2d-4fc9d8b4b6be', 'a7db5cee-fd16-4b45-b99b-45ade93de498'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:53:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:07 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:53:07 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Flow 'volume_create_manager' (a4c165b5-54df-4a01-a1d8-88d2724f8f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3827713a-87b7-451e-8bb3-387fac5ad789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3827713a-87b7-451e-8bb3-387fac5ad789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-678316622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d04b137-7a0e-4d3d-8c39-87cb5272a4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9351921774934609a3b49603079db43a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:09Z,use_quota=True,user_id='3668b133651447b78dc5c0bce586c522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a7acf3-5063-4bb4-90f6-132f5427861b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a7acf3-5063-4bb4-90f6-132f5427861b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c863f67-bc18-4693-9cbd-bcc69200c481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c863f67-bc18-4693-9cbd-bcc69200c481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d04b137-7a0e-4d3d-8c39-87cb5272a4e7', 'volume_name': 'volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ccfd5c-248c-41a5-976f-bac4afc3e5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ccfd5c-248c-41a5-976f-bac4afc3e5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68be24b5-1f43-495e-ba00-7d90906f1895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:08 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Volume 3d04b137-7a0e-4d3d-8c39-87cb5272a4e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7', 'volume_size': 1} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-678316622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d04b137-7a0e-4d3d-8c39-87cb5272a4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9351921774934609a3b49603079db43a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:09Z,use_quota=True,user_id='3668b133651447b78dc5c0bce586c522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Creating volume 3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:53:08 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:53:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:09 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.613s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:09 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:53:09 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Deleted volume successfully. Jul 03 13:53:09 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 1073741824 Jul 03 13:53:09 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3b1bb501-0cd4-4a18-a4df-ed7824d7d467 tempest-VolumesTransfersV355Test-230890496 None] Lock "cinder-51df94ad-536b-4c52-89a1-0be9a4e8c0a1-delete_volume" released by "delete_volume" :: held 4.527s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:53:10 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 1073741824" returned: 0 in 1.592s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:10 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 Jul 03 13:53:10 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:11 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7" returned: 0 in 0.875s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] <== create_volume: return (2560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:53:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.563s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68be24b5-1f43-495e-ba00-7d90906f1895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c901c0-e62a-4818-be9a-aab5552ca166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:11 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Volume volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 (3d04b137-7a0e-4d3d-8c39-87cb5272a4e7): created successfully Jul 03 13:53:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c901c0-e62a-4818-be9a-aab5552ca166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Flow 'volume_create_manager' (a4c165b5-54df-4a01-a1d8-88d2724f8f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:11 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6eca5840-152b-419d-bc4e-9022de9ee290 tempest-TestMinimumBasicScenario-292210944 None] Created volume successfully. Jul 03 13:53:14 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b4264a54-a84c-49a1-8c1e-8755744539c2 tempest-GroupSnapshotsV319Test-1940835774 None] Group tempest-GroupSnapshotsV319Test-Group-334387963: creating Jul 03 13:53:14 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b4264a54-a84c-49a1-8c1e-8755744539c2 tempest-GroupSnapshotsV319Test-1940835774 None] Group tempest-GroupSnapshotsV319Test-Group-334387963: created successfully Jul 03 13:53:14 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b4264a54-a84c-49a1-8c1e-8755744539c2 tempest-GroupSnapshotsV319Test-1940835774 None] Create group completed successfully. Jul 03 13:53:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-3f6fe3c3-9596-4825-b5d1-fb91fefe7778 req-cc73d322-5191-4471-868f-f64f2b17baa7 tempest-TestMinimumBasicScenario-292210944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-3f6fe3c3-9596-4825-b5d1-fb91fefe7778 req-cc73d322-5191-4471-868f-f64f2b17baa7 tempest-TestMinimumBasicScenario-292210944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa25857-55b4-481c-874e-b95bc428a472]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-3f6fe3c3-9596-4825-b5d1-fb91fefe7778 req-cc73d322-5191-4471-868f-f64f2b17baa7 tempest-TestMinimumBasicScenario-292210944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:16 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 Jul 03 13:53:16 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Flow 'volume_create_manager' (c762370c-02bf-4f35-8e53-8209c379642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d10df0-6e3a-49ac-b8de-1efe7eb4796c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d10df0-6e3a-49ac-b8de-1efe7eb4796c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1637719708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14c917f5-c97e-48e3-b2d2-3825e76593b1,host='devstack@QuobyteHD#QuobyteHD',id=36a1c75d-ce45-4edd-a874-96889934ec5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2f8cbbdaff4504b2590060f0d3541a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:16Z,use_quota=True,user_id='7ae45cd2a9a14de2bad7bd761a0ab9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c0e058e-dc72-4e1a-b62f-5e841eec77d2),volume_type_id=7c0e058e-dc72-4e1a-b62f-5e841eec77d2)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59b9daa-d700-4f73-acb3-06c0c17f07e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59b9daa-d700-4f73-acb3-06c0c17f07e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914b9adf-dde6-41fd-a8f4-3374de3bbf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914b9adf-dde6-41fd-a8f4-3374de3bbf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a1c75d-ce45-4edd-a874-96889934ec5a', 'volume_name': 'volume-36a1c75d-ce45-4edd-a874-96889934ec5a', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22d7313-529d-4f6c-aa17-d5c7ceaa4e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22d7313-529d-4f6c-aa17-d5c7ceaa4e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2165e2-76c0-4839-8d8d-6d8c86f3b9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:16 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Volume 36a1c75d-ce45-4edd-a874-96889934ec5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a1c75d-ce45-4edd-a874-96889934ec5a', 'volume_size': 1} Jul 03 13:53:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:17 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-3f6fe3c3-9596-4825-b5d1-fb91fefe7778 req-cc73d322-5191-4471-868f-f64f2b17baa7 tempest-TestMinimumBasicScenario-292210944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7" returned: 0 in 1.146s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-3f6fe3c3-9596-4825-b5d1-fb91fefe7778 req-cc73d322-5191-4471-868f-f64f2b17baa7 tempest-TestMinimumBasicScenario-292210944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.172s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=14c917f5-c97e-48e3-b2d2-3825e76593b1,created_at=2026-07-03T11:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1637719708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14c917f5-c97e-48e3-b2d2-3825e76593b1,host='devstack@QuobyteHD#QuobyteHD',id=36a1c75d-ce45-4edd-a874-96889934ec5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2f8cbbdaff4504b2590060f0d3541a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:16Z,use_quota=True,user_id='7ae45cd2a9a14de2bad7bd761a0ab9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c0e058e-dc72-4e1a-b62f-5e841eec77d2),volume_type_id=7c0e058e-dc72-4e1a-b62f-5e841eec77d2)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Creating volume 36a1c75d-ce45-4edd-a874-96889934ec5a {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:53:17 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:17 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a 1073741824 Jul 03 13:53:17 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-3f6fe3c3-9596-4825-b5d1-fb91fefe7778 req-cc73d322-5191-4471-868f-f64f2b17baa7 tempest-TestMinimumBasicScenario-292210944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '436b67d7-8945-4b5b-9ed4-97a006033ed4', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:53:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-3f6fe3c3-9596-4825-b5d1-fb91fefe7778 req-cc73d322-5191-4471-868f-f64f2b17baa7 tempest-TestMinimumBasicScenario-292210944 None] attachment_update completed successfully. Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Flow 'volume_create_manager' (e6b3b047-f51e-4c9a-bc0b-f68643b18c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f796962-23fd-4165-8508-0e18e8d394bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f796962-23fd-4165-8508-0e18e8d394bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1940517490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520bfe05-8b8e-4004-b26d-4d0669d23222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929dce5cdcc444f692402a6e6ebd2552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:18Z,use_quota=True,user_id='652d07c2b25446aa8c39a898987c2076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf41070-fa89-4479-9c6e-3a0602d09efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf41070-fa89-4479-9c6e-3a0602d09efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb4620b-8102-420b-a7a9-d1b39e87789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb4620b-8102-420b-a7a9-d1b39e87789c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '520bfe05-8b8e-4004-b26d-4d0669d23222', 'volume_name': 'volume-520bfe05-8b8e-4004-b26d-4d0669d23222', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc52aa8e-d392-4a22-aecf-2d2d326bb109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc52aa8e-d392-4a22-aecf-2d2d326bb109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aafeec-53cb-4712-b948-0a7020cc3188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:18 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Volume 520bfe05-8b8e-4004-b26d-4d0669d23222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-520bfe05-8b8e-4004-b26d-4d0669d23222', 'volume_size': 1} Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:18 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a 1073741824" returned: 0 in 1.176s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:18 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a Jul 03 13:53:18 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:19 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a" returned: 0 in 0.674s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.935s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1940517490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520bfe05-8b8e-4004-b26d-4d0669d23222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929dce5cdcc444f692402a6e6ebd2552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:18Z,use_quota=True,user_id='652d07c2b25446aa8c39a898987c2076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Creating volume 520bfe05-8b8e-4004-b26d-4d0669d23222 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:53:19 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-520bfe05-8b8e-4004-b26d-4d0669d23222 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:19 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-520bfe05-8b8e-4004-b26d-4d0669d23222 1073741824 Jul 03 13:53:19 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2165e2-76c0-4839-8d8d-6d8c86f3b9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a1c75d-ce45-4edd-a874-96889934ec5a', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38359ab0-f794-4530-9fdd-8171fff0af61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:19 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Volume volume-36a1c75d-ce45-4edd-a874-96889934ec5a (36a1c75d-ce45-4edd-a874-96889934ec5a): created successfully Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38359ab0-f794-4530-9fdd-8171fff0af61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Flow 'volume_create_manager' (c762370c-02bf-4f35-8e53-8209c379642e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:19 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-0f630d2f-2fd5-408b-94cb-ef8062bc2364 tempest-GroupSnapshotsV319Test-1940835774 None] Created volume successfully. Jul 03 13:53:19 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-520bfe05-8b8e-4004-b26d-4d0669d23222 1073741824" returned: 0 in 0.802s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-520bfe05-8b8e-4004-b26d-4d0669d23222 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:19 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-520bfe05-8b8e-4004-b26d-4d0669d23222 Jul 03 13:53:19 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:20 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] GroupSnapshot df16a92d-5904-415c-85c8-5bc626edafc1: creating. Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] Group snapshot df16a92d-5904-415c-85c8-5bc626edafc1: creating. {{(pid=86729) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:20 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-dafa2676-1641-4bfe-96ea-0a6d366acfaa req-20fde930-7fff-47e1-b8bf-e3b8fd389c18 tempest-AttachVolumeTestJSON-25329155 None] Terminate volume connection completed successfully. Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-dafa2676-1641-4bfe-96ea-0a6d366acfaa req-20fde930-7fff-47e1-b8bf-e3b8fd389c18 tempest-AttachVolumeTestJSON-25329155 None] Deleting attachment fdd56b24-1889-4022-9660-e2f65428213b. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:53:20 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-520bfe05-8b8e-4004-b26d-4d0669d23222" returned: 0 in 0.728s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.281s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aafeec-53cb-4712-b948-0a7020cc3188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-520bfe05-8b8e-4004-b26d-4d0669d23222', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1fdf4a8-62ef-45ec-b9b8-930366a298a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] Creating offline snapshot eb81f257-9a28-48b1-9072-1cca9f6d7dc9 of volume 36a1c75d-ce45-4edd-a874-96889934ec5a {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bf76df-9199-4ae7-9711-c80e28efec34]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:20 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Volume volume-520bfe05-8b8e-4004-b26d-4d0669d23222 (520bfe05-8b8e-4004-b26d-4d0669d23222): created successfully Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1fdf4a8-62ef-45ec-b9b8-930366a298a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Flow 'volume_create_manager' (e6b3b047-f51e-4c9a-bc0b-f68643b18c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:20 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7bf28994-7b2d-41cb-9b05-8be04d36b898 tempest-VolumesTransfersV357Test-779766642 None] Created volume successfully. Jul 03 13:53:20 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a Jul 03 13:53:20 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:21 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a" returned: 0 in 0.841s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:21 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 1G Jul 03 13:53:21 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:21 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-96f13ea5-7fc7-40a3-854f-43e6b65bc2d0 tempest-VolumesTransfersV357Test-699534335 None] Transfer volume completed successfully. Jul 03 13:53:22 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 1G" returned: 0 in 1.010s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a1c75d-ce45-4edd-a874-96889934ec5a -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:22 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a1c75d-ce45-4edd-a874-96889934ec5a -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 Jul 03 13:53:22 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Acquiring lock "cinder-520bfe05-8b8e-4004-b26d-4d0669d23222-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:53:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Lock "cinder-520bfe05-8b8e-4004-b26d-4d0669d23222-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:53:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Acquiring lock "cinder-quobyte-520bfe05-8b8e-4004-b26d-4d0669d23222" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:53:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Lock "cinder-quobyte-520bfe05-8b8e-4004-b26d-4d0669d23222" acquired by "delete_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:53:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65e9dec-d672-4fe4-b8d7-7ff3bd2c4f4e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-520bfe05-8b8e-4004-b26d-4d0669d23222 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:23 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a1c75d-ce45-4edd-a874-96889934ec5a -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9" returned: 0 in 0.915s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:23 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:53:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:23 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-520bfe05-8b8e-4004-b26d-4d0669d23222 Jul 03 13:53:23 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:23 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 Jul 03 13:53:23 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:24 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-520bfe05-8b8e-4004-b26d-4d0669d23222" returned: 0 in 1.689s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-520bfe05-8b8e-4004-b26d-4d0669d23222 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:24 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9" returned: 0 in 1.442s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:24 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-520bfe05-8b8e-4004-b26d-4d0669d23222 Jul 03 13:53:24 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:25 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.info Jul 03 13:53:25 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:53:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:25 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.info" returned: 0 in 1.034s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:26 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:53:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:26 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:53:26 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:26 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.info Jul 03 13:53:26 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:26 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-520bfe05-8b8e-4004-b26d-4d0669d23222" returned: 0 in 1.270s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Lock "cinder-quobyte-520bfe05-8b8e-4004-b26d-4d0669d23222" released by "delete_volume" :: held 3.066s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:53:26 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Created reservations ['cce6bc5b-6d24-49a5-a8c9-0348075bd64d', 'bf90dcf7-b012-4dba-8f8b-55f477fd9d0a', 'd0ebb555-4261-442d-b308-9f01eedc83e6', '5d51a5c0-cb47-4912-9710-86c9b45b13e5'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:53:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:26 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:53:26 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:27 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.info" returned: 0 in 1.376s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.779s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:27 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.580s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:27 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:53:27 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-92e20366-2e6d-42fd-8ae3-efc4d1f2552c tempest-GroupSnapshotsV319Test-1940835774 None] group_snapshot df16a92d-5904-415c-85c8-5bc626edafc1: created successfully Jul 03 13:53:28 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.533s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:53:28 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Deleted volume successfully. Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e5933e12-7783-4574-9905-ed406c8acd03 tempest-VolumesTransfersV357Test-1534927857 None] Lock "cinder-520bfe05-8b8e-4004-b26d-4d0669d23222-delete_volume" released by "delete_volume" :: held 5.190s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Flow 'volume_create_manager' (83d4a1cd-bfd3-43ea-97f1-23a38d99b264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc11359-eca4-4f28-9b44-6bf3ab745fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc11359-eca4-4f28-9b44-6bf3ab745fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1805510008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929dce5cdcc444f692402a6e6ebd2552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:28Z,use_quota=True,user_id='652d07c2b25446aa8c39a898987c2076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03aaa1a0-aea7-41d0-b3f7-e5a9d433e98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03aaa1a0-aea7-41d0-b3f7-e5a9d433e98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b859cb4-1e9f-45e7-99d8-d3abd84e91fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b859cb4-1e9f-45e7-99d8-d3abd84e91fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc', 'volume_name': 'volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a3b3fa-1c36-4736-bc83-e24d14985495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a3b3fa-1c36-4736-bc83-e24d14985495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d6391c-5fdf-4b2f-add7-279ca83fd4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:28 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Volume 707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc', 'volume_size': 1} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1805510008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929dce5cdcc444f692402a6e6ebd2552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:28Z,use_quota=True,user_id='652d07c2b25446aa8c39a898987c2076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Creating volume 707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:53:28 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:28 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc 1073741824 Jul 03 13:53:28 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:28 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] group_snapshot df16a92d-5904-415c-85c8-5bc626edafc1: deleting Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] group_snapshot df16a92d-5904-415c-85c8-5bc626edafc1: deleting {{(pid=86729) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Acquiring lock "cinder-quobyte-36a1c75d-ce45-4edd-a874-96889934ec5a" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Lock "cinder-quobyte-36a1c75d-ce45-4edd-a874-96889934ec5a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Acquiring lock "cinder-quobyte-eb81f257-9a28-48b1-9072-1cca9f6d7dc9" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Lock "cinder-quobyte-eb81f257-9a28-48b1-9072-1cca9f6d7dc9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Deleting offline snapshot eb81f257-9a28-48b1-9072-1cca9f6d7dc9 of volume 36a1c75d-ce45-4edd-a874-96889934ec5a {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] snapshot_file for this snap is: volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[369dda53-3b66-4d64-9a9c-bd17a5872553]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:29 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 Jul 03 13:53:29 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:29 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc 1073741824" returned: 0 in 1.069s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:29 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc Jul 03 13:53:29 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:29 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9" returned: 0 in 1.021s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a1c75d-ce45-4edd-a874-96889934ec5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:53:29 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd7f255-6981-495d-8dd1-0aacc5ec192f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:30 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a Jul 03 13:53:30 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:30 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc" returned: 0 in 0.827s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:53:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:30 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d6391c-5fdf-4b2f-add7-279ca83fd4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:30 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a972f70-9719-4c8d-8958-4858cf057efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:30 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Volume volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc (707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc): created successfully Jul 03 13:53:30 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a972f70-9719-4c8d-8958-4858cf057efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:30 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Flow 'volume_create_manager' (83d4a1cd-bfd3-43ea-97f1-23a38d99b264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:30 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-fff95569-ec3b-41e0-b560-8c26520c6e86 tempest-VolumesTransfersV357Test-779766642 None] Created volume successfully. Jul 03 13:53:30 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a" returned: 0 in 0.993s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:30 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 Jul 03 13:53:30 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:31 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9" returned: 0 in 0.817s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:31 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9 Jul 03 13:53:31 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Acquiring lock "cinder-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:53:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Lock "cinder-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:53:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Acquiring lock "cinder-quobyte-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:53:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Lock "cinder-quobyte-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc" acquired by "delete_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:53:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a43b0f-17d6-4a06-819e-5900d119c440]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:32 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc Jul 03 13:53:32 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:32 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a.eb81f257-9a28-48b1-9072-1cca9f6d7dc9" returned: 0 in 0.787s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Lock "cinder-quobyte-eb81f257-9a28-48b1-9072-1cca9f6d7dc9" released by "_delete_snapshot" :: held 3.780s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:53:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Lock "cinder-quobyte-36a1c75d-ce45-4edd-a874-96889934ec5a" released by "delete_snapshot" :: held 3.807s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:53:32 devstack cinder-volume[86729]: WARNING cinder.quota [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1831058843 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1831058843, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:53:32 devstack cinder-volume[86729]: WARNING cinder.quota [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1831058843 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1831058843, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:53:32 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] Created reservations ['8e900bf5-f6d3-4571-baeb-ada1ca60b772', 'cbf809dc-2852-4546-af02-b131071e77ab', '95382447-504a-4b88-9724-dda36d40993a', '0a539718-06f3-4f37-85b4-9a9c37296340'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:53:32 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7fecf6a9-d1b1-4517-9085-49bb2a13bb32 tempest-GroupSnapshotsV319Test-1940835774 None] group_snapshot df16a92d-5904-415c-85c8-5bc626edafc1: deleted successfully Jul 03 13:53:32 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc" returned: 0 in 0.840s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:32 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc Jul 03 13:53:32 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Acquiring lock "cinder-quobyte-36a1c75d-ce45-4edd-a874-96889934ec5a" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Lock "cinder-quobyte-36a1c75d-ce45-4edd-a874-96889934ec5a" acquired by "delete_volume" :: waited 0.035s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8851a53e-5499-47ef-b2bd-62c14459a2e6]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:33 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc" returned: 0 in 0.810s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Lock "cinder-quobyte-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc" released by "delete_volume" :: held 1.706s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Created reservations ['ee8ea5ef-0cfc-4faa-ba20-e5b2ce25d2e3', '6891e9ac-bcfc-4a02-be1d-f7fac701d618', '91684509-9c2a-486a-b2e4-d0c2eb23f226', 'eaeb639c-1cc6-4bc4-bbaf-8b39728d5f71'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:53:33 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a Jul 03 13:53:33 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:33 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:53:33 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:34 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a" returned: 0 in 1.120s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:34 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a Jul 03 13:53:34 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:35 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.172s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:35 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:53:35 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Deleted volume successfully. Jul 03 13:53:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e908bb02-d430-4872-b9d8-486c897637ae tempest-VolumesTransfersV357Test-1534927857 None] Lock "cinder-707f8ea8-d7dc-4bf1-a5ad-6b391fdd5dcc-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:53:36 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-36a1c75d-ce45-4edd-a874-96889934ec5a" returned: 0 in 1.245s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Lock "cinder-quobyte-36a1c75d-ce45-4edd-a874-96889934ec5a" released by "delete_volume" :: held 2.511s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:53:36 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Created reservations ['c64da3d4-c28f-467a-a75a-9157d5aa6263'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:53:36 devstack cinder-volume[86729]: WARNING cinder.quota [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1831058843 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1831058843, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:53:36 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Created reservations ['c2331390-a37e-45f0-b353-9cf2eee0e646', 'e9c02d63-896f-41c6-bf35-9fed44a4d2e9', '7cce64d8-b45f-4c0a-a293-7bbb87ac80c6', 'a57e5e63-8471-4a14-b2ab-9927a8eb1015'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:53:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:36 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:53:36 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:37 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.955s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:37 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:53:37 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e79db0a8-7b20-479c-a333-4b7117604d3d tempest-GroupSnapshotsV319Test-1940835774 None] Delete group completed successfully. Jul 03 13:53:46 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=73,cinder:INSERT=22,cinder:UPDATE=97,cinder:DELETE=7 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:53:46 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=87,cinder:INSERT=23,cinder:UPDATE=91,cinder:DELETE=6 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:53:46 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ee0ce2fd-bc81-47bf-9fb9-1618dc245f13 tempest-GroupsV314Test-592749226 None] Group tempest-GroupsV314Test-Group-1725757253: creating Jul 03 13:53:46 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ee0ce2fd-bc81-47bf-9fb9-1618dc245f13 tempest-GroupsV314Test-592749226 None] Group tempest-GroupsV314Test-Group-1725757253: created successfully Jul 03 13:53:46 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ee0ce2fd-bc81-47bf-9fb9-1618dc245f13 tempest-GroupsV314Test-592749226 None] Create group completed successfully. Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Flow 'volume_create_manager' (e9b7d5ab-b02b-479f-8846-b70a72332235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf76f07-5da3-41dd-a6a3-f97039e90bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf76f07-5da3-41dd-a6a3-f97039e90bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-918645360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=92273837-a512-4105-bfef-022c49f1aa02,host='devstack@QuobyteHD#QuobyteHD',id=72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ed33e0abf34579845f948624e2ad24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:49Z,use_quota=True,user_id='e3810b6f7c4b44e18de760b3f59f7bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ce8129f-9588-4d2c-8f8a-82606c050544),volume_type_id=9ce8129f-9588-4d2c-8f8a-82606c050544)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bd617e-9589-41be-8d55-6b5bda0c930e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bd617e-9589-41be-8d55-6b5bda0c930e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eaa1c5e-1619-43cc-8b0d-3936355c9a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eaa1c5e-1619-43cc-8b0d-3936355c9a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30', 'volume_name': 'volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be66412-8a3e-41be-9b52-aab6e428cea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be66412-8a3e-41be-9b52-aab6e428cea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350256fc-29bb-4652-9a43-926ff724fe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:48 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Volume 72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30', 'volume_size': 1} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=92273837-a512-4105-bfef-022c49f1aa02,created_at=2026-07-03T11:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-918645360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=92273837-a512-4105-bfef-022c49f1aa02,host='devstack@QuobyteHD#QuobyteHD',id=72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ed33e0abf34579845f948624e2ad24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:49Z,use_quota=True,user_id='e3810b6f7c4b44e18de760b3f59f7bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ce8129f-9588-4d2c-8f8a-82606c050544),volume_type_id=9ce8129f-9588-4d2c-8f8a-82606c050544)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Creating volume 72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:53:48 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:53:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:48 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 1073741824 Jul 03 13:53:48 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:49 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 1073741824" returned: 0 in 1.087s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:50 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 Jul 03 13:53:50 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:50 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30" returned: 0 in 0.823s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:53:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350256fc-29bb-4652-9a43-926ff724fe96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21bac66-dfc6-4feb-b9d1-bab156a01b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:50 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Volume volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 (72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30): created successfully Jul 03 13:53:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21bac66-dfc6-4feb-b9d1-bab156a01b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Flow 'volume_create_manager' (e9b7d5ab-b02b-479f-8846-b70a72332235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1a3150b5-854c-4cd5-bf7d-b809795f96e1 tempest-GroupsV314Test-592749226 None] Created volume successfully. Jul 03 13:53:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:52 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Cloning volume 72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 to volume 0a6f6741-0444-47de-a408-9a0422702fbb Jul 03 13:53:52 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Creating offline snapshot 01d3a9f8-8fa4-4ab5-9815-780176ad4f7d of volume 72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:53:52 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2bf3c0-d879-4ef1-a44b-cd4fa0689645]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:52 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 Jul 03 13:53:52 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:53 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30" returned: 0 in 0.938s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:53 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d 1G Jul 03 13:53:53 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:54 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d 1G" returned: 0 in 0.951s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:54 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d Jul 03 13:53:54 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:55 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d" returned: 0 in 0.717s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:55 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:53:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:55 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d Jul 03 13:53:55 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:56 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d" returned: 0 in 0.991s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:56 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.info Jul 03 13:53:56 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:57 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.info" returned: 0 in 0.771s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:57 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:57 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.info Jul 03 13:53:57 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Flow 'volume_create_manager' (f5c3eb14-128e-471c-bdf8-aa2e3a65634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b69cbb-f7a8-4e15-8eb2-81b90a9c0b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b69cbb-f7a8-4e15-8eb2-81b90a9c0b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-986839354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff0d1f4-84fd-4df9-add5-c6071df34471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3ca60d69cf4799b13f3b4453870a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:57Z,use_quota=True,user_id='e50669595dcb4cb4a6c880006a8d20b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a73bb00-ed09-40db-9211-705e0a9a8e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a73bb00-ed09-40db-9211-705e0a9a8e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5759952-d620-49be-9925-30cc67881cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5759952-d620-49be-9925-30cc67881cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff0d1f4-84fd-4df9-add5-c6071df34471', 'volume_name': 'volume-6ff0d1f4-84fd-4df9-add5-c6071df34471', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024076af-696c-463b-af07-5bfa9963def7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024076af-696c-463b-af07-5bfa9963def7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff527301-2ea7-4433-a158-b9cb88b15658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:53:57 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Volume 6ff0d1f4-84fd-4df9-add5-c6071df34471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff0d1f4-84fd-4df9-add5-c6071df34471', 'volume_size': 1} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:57 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.info" returned: 0 in 0.793s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Acquiring lock "cinder-quobyte-0a6f6741-0444-47de-a408-9a0422702fbb" by "_copy_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Lock "cinder-quobyte-0a6f6741-0444-47de-a408-9a0422702fbb" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] snapshot: 01d3a9f8-8fa4-4ab5-9815-780176ad4f7d, volume: 0a6f6741-0444-47de-a408-9a0422702fbb, {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b981ae-c0be-4e83-ae67-5254df3b6b58]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:58 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d Jul 03 13:53:58 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:58 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d" returned: 0 in 0.803s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:53:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] will copy from snapshot at /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:53:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Creating direct copy from snapshot {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:53:58 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0620560-7343-4c4c-b0fe-6f0d0d3a542c]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:53:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:58 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 Jul 03 13:53:58 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:53:59 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Jul 03 13:53:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30" returned: 0 in 0.851s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:53:59 devstack cinder-volume[86729]: DEBUG cinder.utils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Path /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb not found in is_blk_device check {{(pid=86729) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:53:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:53:59 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb Jul 03 13:53:59 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:05 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb" returned: 0 in 5.498s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:05 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[387f0ac2-1ab9-49c9-8763-de7aa6f6a66c]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:05 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 Jul 03 13:54:05 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:06 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=11,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:54:06 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30" returned: 0 in 1.166s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:06 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:54:06 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Converted 1024.00 MB image at 186.22 MB/s Jul 03 13:54:06 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb is being set with open permissions: ugo+rw: NotImplementedError Jul 03 13:54:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:06 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb Jul 03 13:54:06 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:07 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb" returned: 0 in 0.683s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Lock "cinder-quobyte-0a6f6741-0444-47de-a408-9a0422702fbb" released by "_copy_volume_from_snapshot" :: held 9.107s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Acquiring lock "cinder-quobyte-01d3a9f8-8fa4-4ab5-9815-780176ad4f7d" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Lock "cinder-quobyte-01d3a9f8-8fa4-4ab5-9815-780176ad4f7d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Deleting offline snapshot 01d3a9f8-8fa4-4ab5-9815-780176ad4f7d of volume 72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:54:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] snapshot_file for this snap is: volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:54:07 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f123cd-e9bb-4379-8ad3-347c33df95a0]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:07 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d Jul 03 13:54:07 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:07 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=8,cinder:SELECT=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:54:08 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d" returned: 0 in 0.995s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:54:08 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cceac6d-82c4-423e-8d12-a40db6476664]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:08 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 Jul 03 13:54:08 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:09 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30" returned: 0 in 0.877s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:09 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d Jul 03 13:54:09 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:09 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d" returned: 0 in 0.750s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:09 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d Jul 03 13:54:09 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:10 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-cdd0377b-92f6-4891-99dc-592c1a926275 req-c87d981c-46b6-4fca-8b4c-70ad653a7c04 tempest-TestMinimumBasicScenario-292210944 None] Terminate volume connection completed successfully. Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-cdd0377b-92f6-4891-99dc-592c1a926275 req-c87d981c-46b6-4fca-8b4c-70ad653a7c04 tempest-TestMinimumBasicScenario-292210944 None] Deleting attachment 436b67d7-8945-4b5b-9ed4-97a006033ed4. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:54:10 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30.01d3a9f8-8fa4-4ab5-9815-780176ad4f7d" returned: 0 in 0.792s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Lock "cinder-quobyte-01d3a9f8-8fa4-4ab5-9815-780176ad4f7d" released by "_delete_snapshot" :: held 3.536s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.062s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.183s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-986839354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff0d1f4-84fd-4df9-add5-c6071df34471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3ca60d69cf4799b13f3b4453870a3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:53:57Z,use_quota=True,user_id='e50669595dcb4cb4a6c880006a8d20b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Creating volume 6ff0d1f4-84fd-4df9-add5-c6071df34471 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:54:10 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:54:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:10 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 1073741824 Jul 03 13:54:10 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:10 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d2e23353-b377-4d09-b2ca-3c375191dad2 tempest-GroupsV314Test-592749226 None] Create group from source-group-92273837-a512-4105-bfef-022c49f1aa02 completed successfully. Jul 03 13:54:11 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 1073741824" returned: 0 in 0.898s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:11 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 Jul 03 13:54:11 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Acquiring lock "cinder-quobyte-0a6f6741-0444-47de-a408-9a0422702fbb" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Lock "cinder-quobyte-0a6f6741-0444-47de-a408-9a0422702fbb" acquired by "delete_volume" :: waited 0.029s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a69b43f-8413-4fc4-94ed-2b8e1d10d3c9]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Acquiring lock "cinder-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Lock "cinder-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Acquiring lock "cinder-quobyte-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Lock "cinder-quobyte-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7" acquired by "delete_volume" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:12 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb Jul 03 13:54:12 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[930c91e4-3185-4c04-8e40-35296e9e3c73]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:12 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471" returned: 0 in 0.851s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff527301-2ea7-4433-a158-b9cb88b15658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff0d1f4-84fd-4df9-add5-c6071df34471', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2100866e-b8c5-4de1-91a9-b87fd48ea44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:12 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Volume volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 (6ff0d1f4-84fd-4df9-add5-c6071df34471): created successfully Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2100866e-b8c5-4de1-91a9-b87fd48ea44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:12 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 Jul 03 13:54:12 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Flow 'volume_create_manager' (f5c3eb14-128e-471c-bdf8-aa2e3a65634c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:54:12 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e458c4f5-50cc-4e15-9374-ab09cc319b89 tempest-VolumesActionsTest-1642662456 None] Created volume successfully. Jul 03 13:54:13 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb" returned: 0 in 0.893s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:13 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb Jul 03 13:54:13 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:13 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7" returned: 0 in 0.895s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:13 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7 Jul 03 13:54:13 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:13 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0a6f6741-0444-47de-a408-9a0422702fbb" returned: 0 in 0.862s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:13 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Lock "cinder-quobyte-0a6f6741-0444-47de-a408-9a0422702fbb" released by "delete_volume" :: held 1.820s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7" returned: 0 in 0.734s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Lock "cinder-quobyte-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7" released by "delete_volume" :: held 1.689s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Created reservations ['6869df65-d5f9-4313-954d-62b30c6dcc67'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Created reservations ['7f3eb8ae-f02e-4036-9cf9-106e24201607', 'e173139d-e1a4-4156-ae13-63f09d3e93a2', '1482cb66-a521-49b2-ba4e-428f58e8c9d9', 'a4a884e7-d379-41b6-98f0-7719ac79a3ae'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:54:14 devstack cinder-volume[86729]: WARNING cinder.quota [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-185789111 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-185789111, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:54:14 devstack cinder-volume[86729]: WARNING cinder.quota [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-185789111 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-185789111, it is now deprecated. Please use the default quota class for default quota. Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Created reservations ['3831a688-6954-483b-b471-9b7a20d665f4', '000b050c-8318-46fa-bbd5-5d5647f97bd4', 'c640ae30-becb-47f0-a09d-b4c745ae08d5', '9fe9b157-0813-4e9d-b399-6ca8c2ede2e8'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:14 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:54:14 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:14 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:54:14 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:15 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.958s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:15 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:54:15 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Deleted volume successfully. Jul 03 13:54:15 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Acquiring lock "cinder-quobyte-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:15 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eaaeb83f-9468-4096-8c16-fa7e9a384dd2 tempest-TestMinimumBasicScenario-292210944 None] Lock "cinder-3d04b137-7a0e-4d3d-8c39-87cb5272a4e7-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:15 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Lock "cinder-quobyte-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30" acquired by "delete_volume" :: waited 0.031s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:15 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9da097-de71-4ae0-9f6b-1574202d3526]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:15 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.081s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:15 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 Jul 03 13:54:15 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:15 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:54:15 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-600f78b7-afe6-4669-b5f8-eaa4f231324f tempest-GroupsV314Test-592749226 None] Delete group completed successfully. Jul 03 13:54:16 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30" returned: 0 in 1.025s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:16 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30 Jul 03 13:54:16 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:17 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30" returned: 0 in 0.782s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Lock "cinder-quobyte-72a8ae28-e9d3-49c7-9b2e-3fe7403cbe30" released by "delete_volume" :: held 1.893s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:17 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Created reservations ['9846fb45-cb0f-4f5d-a204-1acefc6c4eb9'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:54:17 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Created reservations ['ca19912f-ab4c-4cd5-8403-5be9227f188f', '1c927736-3576-494f-b477-33fba480a0ce', 'a95b6222-0115-4ff4-9ba6-88cfb0bde808', '2c5ee5b8-a7a4-4fe4-abce-cd3b0bd2f4c0'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:54:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:17 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:54:17 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:18 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.784s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:18 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:54:18 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-acc08322-a8c6-42f0-a6ef-ee85b52f133a tempest-GroupsV314Test-592749226 None] Delete group completed successfully. Jul 03 13:54:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:54:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:26 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:54:26 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:26 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.939s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:54:27 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=19,cinder:UPDATE=35,cinder:DELETE=1,cinder:INSERT=11 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:54:27 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=35,cinder:SELECT=35,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:54:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-edab1404-00bf-4d7f-8b95-cd5911e02514 tempest-VolumesActionsTest-1642662456 None] Acquiring lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471" by "attach_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-edab1404-00bf-4d7f-8b95-cd5911e02514 tempest-VolumesActionsTest-1642662456 None] Lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471" acquired by "attach_volume" :: waited 0.074s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:33 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-edab1404-00bf-4d7f-8b95-cd5911e02514 tempest-VolumesActionsTest-1642662456 None] Attaching volume 6ff0d1f4-84fd-4df9-add5-c6071df34471 to instance 7cc4fb1d-dbdb-4964-8211-bc5cfa872a08 at mountpoint /dev/vdb on host None. Jul 03 13:54:33 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-edab1404-00bf-4d7f-8b95-cd5911e02514 tempest-VolumesActionsTest-1642662456 None] Attach volume completed successfully. Jul 03 13:54:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-edab1404-00bf-4d7f-8b95-cd5911e02514 tempest-VolumesActionsTest-1642662456 None] Lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471" released by "attach_volume" :: held 0.194s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e5ad3ce1-f271-4e56-a334-d8db058dcd8a tempest-VolumesActionsTest-1642662456 None] Acquiring lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471-detach_volume" by "detach_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e5ad3ce1-f271-4e56-a334-d8db058dcd8a tempest-VolumesActionsTest-1642662456 None] Lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:33 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e5ad3ce1-f271-4e56-a334-d8db058dcd8a tempest-VolumesActionsTest-1642662456 None] Detaching volume 6ff0d1f4-84fd-4df9-add5-c6071df34471 from instance 7cc4fb1d-dbdb-4964-8211-bc5cfa872a08. Jul 03 13:54:33 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e5ad3ce1-f271-4e56-a334-d8db058dcd8a tempest-VolumesActionsTest-1642662456 None] Detach volume completed successfully. Jul 03 13:54:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e5ad3ce1-f271-4e56-a334-d8db058dcd8a tempest-VolumesActionsTest-1642662456 None] Lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Flow 'volume_create_manager' (820e22f9-f750-4aca-a827-32e3a48a20f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ec5844-6ccd-4988-ae40-0cf353f21e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ec5844-6ccd-4988-ae40-0cf353f21e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1967658857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8637605f-c47c-4e06-9c32-65c3cb858e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66fe1dec09704bd1be9084585cab21d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:54:38Z,use_quota=True,user_id='501832114f8e4fc5b88baf2e30f803f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ae91e0-2827-4a77-b32a-482a77049634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ae91e0-2827-4a77-b32a-482a77049634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797b7aa1-cb05-40bc-bfa8-ce614ca10b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797b7aa1-cb05-40bc-bfa8-ce614ca10b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8637605f-c47c-4e06-9c32-65c3cb858e65', 'volume_name': 'volume-8637605f-c47c-4e06-9c32-65c3cb858e65', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f130a87e-c707-4c28-a198-0a256116a713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f130a87e-c707-4c28-a198-0a256116a713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820f9e33-ef25-4dc1-b1a6-8942f5978a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:38 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Volume 8637605f-c47c-4e06-9c32-65c3cb858e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8637605f-c47c-4e06-9c32-65c3cb858e65', 'volume_size': 1} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1967658857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8637605f-c47c-4e06-9c32-65c3cb858e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66fe1dec09704bd1be9084585cab21d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:54:38Z,use_quota=True,user_id='501832114f8e4fc5b88baf2e30f803f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Creating volume 8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:54:38 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:54:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:38 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 1073741824 Jul 03 13:54:38 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:39 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 1073741824" returned: 0 in 1.227s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:39 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 Jul 03 13:54:39 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:40 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65" returned: 0 in 0.840s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:54:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820f9e33-ef25-4dc1-b1a6-8942f5978a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8637605f-c47c-4e06-9c32-65c3cb858e65', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74970637-70a3-4642-8397-2787cc132ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:40 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Volume volume-8637605f-c47c-4e06-9c32-65c3cb858e65 (8637605f-c47c-4e06-9c32-65c3cb858e65): created successfully Jul 03 13:54:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74970637-70a3-4642-8397-2787cc132ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Flow 'volume_create_manager' (820e22f9-f750-4aca-a827-32e3a48a20f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:54:40 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-994e6029-b732-4c63-8367-e27dd30aca98 tempest-SnapshotsActionsTest-570221400 None] Created volume successfully. Jul 03 13:54:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] Creating offline snapshot 7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 of volume 8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:54:41 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a36a8d2-5325-46ab-ba2d-1d208daf5803]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:42 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 Jul 03 13:54:42 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:42 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65" returned: 0 in 1.152s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:43 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 1G Jul 03 13:54:43 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:44 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 1G" returned: 0 in 1.164s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:44 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:54:44 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:45 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 1.007s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:45 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 is being set with open permissions: ugo+rw Jul 03 13:54:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:45 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:54:45 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:45 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 0.713s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:45 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.info Jul 03 13:54:45 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:46 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.info" returned: 0 in 0.684s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:46 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.info is being set with open permissions: ugo+rw Jul 03 13:54:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:46 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.info Jul 03 13:54:46 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.info" returned: 0 in 0.757s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:47 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.621s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:47 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-421d93fa-c9f3-4cf3-b225-d2cdf2d9fa9b tempest-SnapshotsActionsTest-570221400 None] Create snapshot completed successfully Jul 03 13:54:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] Creating offline snapshot 4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e of volume 8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:54:48 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c82e1bc-5aa7-4a94-9159-ab9829937645]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:49 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:54:49 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:50 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 1.068s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:54:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:50 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e 1G Jul 03 13:54:50 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:51 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e 1G" returned: 0 in 1.083s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:51 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e Jul 03 13:54:51 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:52 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e" returned: 0 in 0.892s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:52 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e is being set with open permissions: ugo+rw Jul 03 13:54:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:52 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e Jul 03 13:54:52 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:52 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e" returned: 0 in 0.728s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.916s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:52 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-4d914331-f014-400a-80ec-73fb27fbbd7b tempest-SnapshotsActionsTest-570221400 None] Create snapshot completed successfully Jul 03 13:54:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Acquiring lock "cinder-4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Acquiring lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Acquiring lock "cinder-quobyte-4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Deleting offline snapshot 4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e of volume 8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:54:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] snapshot_file for this snap is: volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:54:53 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01154c7-489b-4a24-ab0f-530a17bfaf5e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:53 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e Jul 03 13:54:53 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:54 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e" returned: 0 in 0.843s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:54:54 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f3ccf6-b809-4ca3-abaf-0196efa46832]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:54:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:54 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:54:54 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:55 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 0.859s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:54:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:55 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e Jul 03 13:54:55 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:56 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e" returned: 0 in 1.271s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:56 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e Jul 03 13:54:56 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Flow 'volume_create_manager' (13d0dbfa-5794-403c-ab41-39ffed590d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be70f7f-fc58-4cca-953d-532ba53423cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be70f7f-fc58-4cca-953d-532ba53423cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1453196537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b09f008-492a-44fa-8bca-aad0d9a859d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b3a6b8556f4c1eb2bbaec25acf21e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:54:57Z,use_quota=True,user_id='bb3b75dc732b48bd97891aa43fcc529c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f78279-456d-4fd4-a725-8d6f20ab163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f78279-456d-4fd4-a725-8d6f20ab163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7ab42f-7eaa-4a59-a06a-f36a6ff67caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7ab42f-7eaa-4a59-a06a-f36a6ff67caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b09f008-492a-44fa-8bca-aad0d9a859d9', 'volume_name': 'volume-2b09f008-492a-44fa-8bca-aad0d9a859d9', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acd51a8-e449-4aca-bb54-198d3e6bc237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acd51a8-e449-4aca-bb54-198d3e6bc237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a48e08e-43a9-402c-9a10-77df9108d3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:54:57 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Volume 2b09f008-492a-44fa-8bca-aad0d9a859d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b09f008-492a-44fa-8bca-aad0d9a859d9', 'volume_size': 1} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1453196537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b09f008-492a-44fa-8bca-aad0d9a859d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b3a6b8556f4c1eb2bbaec25acf21e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:54:57Z,use_quota=True,user_id='bb3b75dc732b48bd97891aa43fcc529c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Creating volume 2b09f008-492a-44fa-8bca-aad0d9a859d9 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:54:57 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:57 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9 1073741824 Jul 03 13:54:57 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:57 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e" returned: 0 in 1.265s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e" released by "_delete_snapshot" :: held 4.444s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" released by "delete_snapshot" :: held 4.477s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:57 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Created reservations ['8d46ac76-4c37-4417-9d22-e28a60830828', '02a8db0a-aa0d-46e8-81e5-be331f748d0d', '24547dfe-f62f-4037-be69-63139dd3a76b', '42d75d78-6286-4c94-8001-953882cfc364'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:54:57 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Delete snapshot completed successfully. Jul 03 13:54:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb5c2c80-46ef-4086-9ad2-75cff3072007 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-4c8dc3c9-9a25-4e7b-a106-39b9cfca0e8e-delete_snapshot" released by "delete_snapshot" :: held 4.683s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:59 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Jul 03 13:54:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9 1073741824" returned: 0 in 1.473s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:54:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:54:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b69e7f65-b984-40ab-a5f5-2bf2b0b95059 tempest-VolumesActionsTest-1642662456 None] Acquiring lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471" by "attach_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:54:59 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9 Jul 03 13:54:59 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:54:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b69e7f65-b984-40ab-a5f5-2bf2b0b95059 tempest-VolumesActionsTest-1642662456 None] Lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471" acquired by "attach_volume" :: waited 0.045s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:54:59 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b69e7f65-b984-40ab-a5f5-2bf2b0b95059 tempest-VolumesActionsTest-1642662456 None] Attaching volume 6ff0d1f4-84fd-4df9-add5-c6071df34471 to instance 1fd5643a-9ab0-4b51-8656-4d45fb1e5d63 at mountpoint /dev/vdb on host None. Jul 03 13:54:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:54:59 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b69e7f65-b984-40ab-a5f5-2bf2b0b95059 tempest-VolumesActionsTest-1642662456 None] Attach volume completed successfully. Jul 03 13:54:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b69e7f65-b984-40ab-a5f5-2bf2b0b95059 tempest-VolumesActionsTest-1642662456 None] Lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471" released by "attach_volume" :: held 0.235s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:54:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f02f6b0c-afe6-4726-b011-aba0c499d015 tempest-VolumesActionsTest-1642662456 None] Acquiring lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471-detach_volume" by "detach_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f02f6b0c-afe6-4726-b011-aba0c499d015 tempest-VolumesActionsTest-1642662456 None] Lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:00 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f02f6b0c-afe6-4726-b011-aba0c499d015 tempest-VolumesActionsTest-1642662456 None] Detaching volume 6ff0d1f4-84fd-4df9-add5-c6071df34471 from instance 1fd5643a-9ab0-4b51-8656-4d45fb1e5d63. Jul 03 13:55:00 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f02f6b0c-afe6-4726-b011-aba0c499d015 tempest-VolumesActionsTest-1642662456 None] Detach volume completed successfully. Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f02f6b0c-afe6-4726-b011-aba0c499d015 tempest-VolumesActionsTest-1642662456 None] Lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:00 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9" returned: 0 in 1.103s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] <== create_volume: return (2700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.704s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.822s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a48e08e-43a9-402c-9a10-77df9108d3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b09f008-492a-44fa-8bca-aad0d9a859d9', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd4f224-30ef-4b89-997c-4bb2a836e46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] Creating offline snapshot 6b366a0b-d06f-4269-9642-6853923350b8 of volume 8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:55:00 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Volume volume-2b09f008-492a-44fa-8bca-aad0d9a859d9 (2b09f008-492a-44fa-8bca-aad0d9a859d9): created successfully Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd4f224-30ef-4b89-997c-4bb2a836e46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Flow 'volume_create_manager' (13d0dbfa-5794-403c-ab41-39ffed590d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[375455d9-f920-480c-af53-5d4049d87d28]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:00 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9b06123e-27b3-4b3a-904a-9f49c0ea67a7 tempest-AttachVolumeTestJSON-25329155 None] Created volume successfully. Jul 03 13:55:00 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:55:00 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:01 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 1.193s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:55:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:01 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 1G Jul 03 13:55:01 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:02 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 1G" returned: 0 in 1.369s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:03 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 Jul 03 13:55:03 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:04 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8" returned: 0 in 1.085s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:04 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 is being set with open permissions: ugo+rw Jul 03 13:55:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-6957fb6e-ac22-464c-ad13-c409400d5a15 req-15a689e4-3fff-4e87-872d-b8d92ac01e35 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:04 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 Jul 03 13:55:04 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:04 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8" returned: 0 in 0.852s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.719s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-6957fb6e-ac22-464c-ad13-c409400d5a15 req-15a689e4-3fff-4e87-872d-b8d92ac01e35 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.870s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:05 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c30f4e-9cb1-4fac-84be-05f46c4d8607]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-6957fb6e-ac22-464c-ad13-c409400d5a15 req-15a689e4-3fff-4e87-872d-b8d92ac01e35 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a238c00f-7c5c-4146-a9ba-ab9ea54bc5ab tempest-SnapshotsActionsTest-570221400 None] Create snapshot completed successfully Jul 03 13:55:05 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9 Jul 03 13:55:05 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:05 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-6957fb6e-ac22-464c-ad13-c409400d5a15 req-15a689e4-3fff-4e87-872d-b8d92ac01e35 tempest-AttachVolumeTestJSON-25329155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9" returned: 0 in 0.952s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-6957fb6e-ac22-464c-ad13-c409400d5a15 req-15a689e4-3fff-4e87-872d-b8d92ac01e35 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.985s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-6957fb6e-ac22-464c-ad13-c409400d5a15 req-15a689e4-3fff-4e87-872d-b8d92ac01e35 tempest-AttachVolumeTestJSON-25329155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-2b09f008-492a-44fa-8bca-aad0d9a859d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cea7ba4-c061-49b7-ab01-97021ef02b1f', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:55:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Acquiring lock "cinder-6b366a0b-d06f-4269-9642-6853923350b8-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-6b366a0b-d06f-4269-9642-6853923350b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Acquiring lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Acquiring lock "cinder-quobyte-6b366a0b-d06f-4269-9642-6853923350b8" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-6b366a0b-d06f-4269-9642-6853923350b8" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Deleting offline snapshot 6b366a0b-d06f-4269-9642-6853923350b8 of volume 8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:55:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] snapshot_file for this snap is: volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:55:06 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-6957fb6e-ac22-464c-ad13-c409400d5a15 req-15a689e4-3fff-4e87-872d-b8d92ac01e35 tempest-AttachVolumeTestJSON-25329155 None] attachment_update completed successfully. Jul 03 13:55:06 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d6fd98-4c4e-4cc6-8e33-0fdb4bbf21c2]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:06 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 Jul 03 13:55:06 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:07 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8" returned: 0 in 1.116s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:55:07 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc048418-3232-49b6-8826-1718fce826f2]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:07 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:55:07 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:08 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 1.077s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:55:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:08 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 Jul 03 13:55:08 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:09 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8" returned: 0 in 1.090s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:09 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8 Jul 03 13:55:09 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:10 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5c56fe-ee3b-463a-8592-50197c13c84b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:10 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.6b366a0b-d06f-4269-9642-6853923350b8" returned: 0 in 0.704s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:10 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 Jul 03 13:55:10 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-6b366a0b-d06f-4269-9642-6853923350b8" released by "_delete_snapshot" :: held 4.144s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" released by "delete_snapshot" :: held 4.183s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:10 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Created reservations ['6c78a64b-0176-426c-8f17-f14b72af236f', '6ddab917-4afc-4ac3-9f05-5066384ad630', '501c1bb9-44d0-492b-8699-fb74a62efdaa', '0d8e9432-69aa-4c5b-ada4-c16fb757d6ad'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:10 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Delete snapshot completed successfully. Jul 03 13:55:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-224b5970-12fb-48eb-b01d-605bafdf11bc tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-6b366a0b-d06f-4269-9642-6853923350b8-delete_snapshot" released by "delete_snapshot" :: held 4.349s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:10 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471" returned: 0 in 0.861s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:10 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d96b8f3-6eeb-4301-8985-620a3ea68dc8]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:11 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 Jul 03 13:55:11 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:11 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471" returned: 0 in 0.910s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.676fee3e-6116-4029-8235-c41a2a4a70a9slj59zal.img {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:11 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.676fee3e-6116-4029-8235-c41a2a4a70a9slj59zal.img Jul 03 13:55:11 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:12 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:55:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Flow 'volume_create_manager' (f8c6caa0-24f2-4772-b848-e446bd9cef28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef560a7-3ef1-4314-a014-1b8d4856ac58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef560a7-3ef1-4314-a014-1b8d4856ac58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-19952669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02edcb60-253b-47b3-8344-152674e282e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b3a6b8556f4c1eb2bbaec25acf21e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:55:12Z,use_quota=True,user_id='bb3b75dc732b48bd97891aa43fcc529c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a71341-c18e-400c-bf53-42fd0e27fdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a71341-c18e-400c-bf53-42fd0e27fdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a3ae1b-d590-40b2-aa84-d49c888ecd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a3ae1b-d590-40b2-aa84-d49c888ecd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02edcb60-253b-47b3-8344-152674e282e0', 'volume_name': 'volume-02edcb60-253b-47b3-8344-152674e282e0', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d225d4e-3d79-402a-812b-7a9c54f4c64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d225d4e-3d79-402a-812b-7a9c54f4c64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe7aa0e-8796-4daa-9769-9f941c03a3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:12 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Volume 02edcb60-253b-47b3-8344-152674e282e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02edcb60-253b-47b3-8344-152674e282e0', 'volume_size': 1} Jul 03 13:55:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:15 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:55:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Flow 'volume_create_manager' (3fe62a39-f806-4b20-9b6b-969f6251e9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2937045c-5af1-4ffe-9641-b8344134665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2937045c-5af1-4ffe-9641-b8344134665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-689814357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c15b9f-0251-4c6b-a516-80787b5db26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f347e427e024af58554920b2edfe1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:55:15Z,use_quota=True,user_id='6bb680c9878d40e5b6ae0855a6a4a5c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0095e74a-d347-4759-9e8b-90cd3ed0c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0095e74a-d347-4759-9e8b-90cd3ed0c08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736f1e57-da11-4ea2-b173-3a961c872e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:15 devstack cinder-volume[86729]: DEBUG cinder.image.glance [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Creating Keystone auth plugin from conf {{(pid=86729) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 13:55:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736f1e57-da11-4ea2-b173-3a961c872e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f4c15b9f-0251-4c6b-a516-80787b5db26a', 'volume_name': 'volume-f4c15b9f-0251-4c6b-a516-80787b5db26a', 'volume_size': 1, 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24c8a015e6c74647b59cf3465f3aee9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'created_at': datetime.datetime(2026, 7, 3, 11, 40, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 40, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ac973f-74ca-4854-a92d-b27851f15a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ac973f-74ca-4854-a92d-b27851f15a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a554e67-2927-4cf0-8c9d-c116716d0dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:16 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Volume f4c15b9f-0251-4c6b-a516-80787b5db26a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f4c15b9f-0251-4c6b-a516-80787b5db26a', 'volume_size': 1, 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24c8a015e6c74647b59cf3465f3aee9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'created_at': datetime.datetime(2026, 7, 3, 11, 40, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 40, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 13:55:16 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Trying to clone f4c15b9f-0251-4c6b-a516-80787b5db26a from image c72364f8-58c5-4ca3-8348-fe92aceb54bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]). {{(pid=86729) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 13:55:16 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 13:55:16 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Image download 20.69 MB at 20.69 MB/s Jul 03 13:55:16 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34f0b68-b052-4cd3-a986-4f62323e3673]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:16 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.676fee3e-6116-4029-8235-c41a2a4a70a9slj59zal.img" returned: 0 in 5.068s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:16 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b55dea-16e3-4617-b5a5-e1ec03501583]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:17 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD Jul 03 13:55:17 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:17 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 Jul 03 13:55:17 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:17 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:17 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Temporary image c72364f8-58c5-4ca3-8348-fe92aceb54bd is fetched for user 6bb680c9878d40e5b6ae0855a6a4a5c0. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 13:55:17 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe69fea-ae3e-4588-8c06-3fbbf824e6dc]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:17 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD Jul 03 13:55:17 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:17 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471" returned: 0 in 0.928s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:17 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.676fee3e-6116-4029-8235-c41a2a4a70a9slj59zal.img {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:55:17 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] Converted 1024.00 MB image at 202.00 MB/s Jul 03 13:55:17 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] 676fee3e-6116-4029-8235-c41a2a4a70a9 was raw, no need to convert to raw {{(pid=86729) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Jul 03 13:55:18 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD" returned: 0 in 0.711s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:55:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:25 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:55:25 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:26 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.686s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:55:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:INSERT=12,cinder:SELECT=48,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:55:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=43,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:55:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.882s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] Uploaded volume to glance image-id: 676fee3e-6116-4029-8235-c41a2a4a70a9. {{(pid=86729) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 13:55:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 25.227s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] Creating offline snapshot 14ef8dd8-1d61-48d7-af3b-73079afc238e of volume 8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:55:37 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-64555373-3e4b-4b7b-a2a0-2b0275c49c92 tempest-VolumesActionsTest-1642662456 None] Copy volume to image completed successfully. Jul 03 13:55:37 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bd284a-4e52-473c-89ab-f1333f1543fe]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:37 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:55:37 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:37 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 0.765s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:55:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:37 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e 1G Jul 03 13:55:37 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:38 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e 1G" returned: 0 in 0.801s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:38 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e Jul 03 13:55:38 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:39 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e" returned: 0 in 0.661s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:39 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e is being set with open permissions: ugo+rw Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:39 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e Jul 03 13:55:39 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:39 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e" returned: 0 in 0.623s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.970s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.684s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-19952669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02edcb60-253b-47b3-8344-152674e282e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b3a6b8556f4c1eb2bbaec25acf21e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:55:12Z,use_quota=True,user_id='bb3b75dc732b48bd97891aa43fcc529c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Creating volume 02edcb60-253b-47b3-8344-152674e282e0 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:55:39 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:55:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:39 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0 1073741824 Jul 03 13:55:39 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:39 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7a9d963c-6afc-437f-9fa2-425ee9650f89 tempest-SnapshotsActionsTest-570221400 None] Create snapshot completed successfully Jul 03 13:55:40 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0 1073741824" returned: 0 in 0.785s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:40 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0 Jul 03 13:55:40 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Acquiring lock "cinder-14ef8dd8-1d61-48d7-af3b-73079afc238e-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-14ef8dd8-1d61-48d7-af3b-73079afc238e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Acquiring lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Acquiring lock "cinder-quobyte-14ef8dd8-1d61-48d7-af3b-73079afc238e" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-14ef8dd8-1d61-48d7-af3b-73079afc238e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Deleting offline snapshot 14ef8dd8-1d61-48d7-af3b-73079afc238e of volume 8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] snapshot_file for this snap is: volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95bcbc5-e442-4736-886a-69fb1ffd8e6d]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:41 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e Jul 03 13:55:41 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:41 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0" returned: 0 in 0.655s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.939s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-689814357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c15b9f-0251-4c6b-a516-80787b5db26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f347e427e024af58554920b2edfe1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:55:15Z,use_quota=True,user_id='6bb680c9878d40e5b6ae0855a6a4a5c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Creating volume f4c15b9f-0251-4c6b-a516-80787b5db26a {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:55:41 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe7aa0e-8796-4daa-9769-9f941c03a3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02edcb60-253b-47b3-8344-152674e282e0', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:41 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a 1073741824 Jul 03 13:55:41 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ba50c3-9896-434a-94a4-ef6d84d4d7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:41 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Volume volume-02edcb60-253b-47b3-8344-152674e282e0 (02edcb60-253b-47b3-8344-152674e282e0): created successfully Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ba50c3-9896-434a-94a4-ef6d84d4d7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Flow 'volume_create_manager' (f8c6caa0-24f2-4772-b848-e446bd9cef28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:41 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3dd2ac9b-4443-4672-87f3-98c27a7702e0 tempest-AttachVolumeTestJSON-25329155 None] Created volume successfully. Jul 03 13:55:41 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e" returned: 0 in 0.760s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7f375d-77b1-4987-9916-3099d2211c29]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:42 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:55:42 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:42 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a 1073741824" returned: 0 in 0.893s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:42 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a Jul 03 13:55:42 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:42 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 0.786s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:42 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:55:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:42 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e Jul 03 13:55:42 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:43 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a" returned: 0 in 0.644s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.084s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad6cb41-29cb-4bc8-ab2d-52051995b2b6]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Attempting download of c72364f8-58c5-4ca3-8348-fe92aceb54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}])) to volume f4c15b9f-0251-4c6b-a516-80787b5db26a. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfcbf8d-0eaa-43f4-b7dd-0ab53fbf3afd]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_u8vozdb5 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:43 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 Jul 03 13:55:43 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:43 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_u8vozdb5 Jul 03 13:55:43 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:43 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e" returned: 0 in 0.816s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:43 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e Jul 03 13:55:43 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:43 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471" returned: 0 in 0.803s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[20612240-5136-4a48-8763-989b82475b5d]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:43 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_u8vozdb5" returned: 0 in 0.802s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_u8vozdb5 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:43 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 Jul 03 13:55:43 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:44 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_u8vozdb5 Jul 03 13:55:44 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:44 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.14ef8dd8-1d61-48d7-af3b-73079afc238e" returned: 0 in 0.669s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-14ef8dd8-1d61-48d7-af3b-73079afc238e" released by "_delete_snapshot" :: held 3.130s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" released by "delete_snapshot" :: held 3.156s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:44 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Created reservations ['16e34b8c-d271-45db-b575-39f33a819818', 'f699426d-b919-4c1a-8286-e9a2bda80c84', 'a5cde0d2-7f99-46d1-8278-759b63e9b986', '39fcc540-ab01-4d26-adb7-1ad52df067ee'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:44 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Delete snapshot completed successfully. Jul 03 13:55:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-16c0d4c5-cb39-413f-8e4a-0c26a483bfb8 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-14ef8dd8-1d61-48d7-af3b-73079afc238e-delete_snapshot" released by "delete_snapshot" :: held 3.312s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:44 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_u8vozdb5" returned: 1 in 0.776s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_u8vozdb5' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:55:44 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ddb77-5e8e-421d-be34-b66c50553327]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:44 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471" returned: 0 in 0.870s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:44 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img Jul 03 13:55:44 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:44 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD Jul 03 13:55:44 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:45 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD" returned: 0 in 0.831s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:45 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] c72364f8-58c5-4ca3-8348-fe92aceb54bd was qcow2, converting to raw {{(pid=86729) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 13:55:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-fa7ec34b-e368-404e-bcbc-89aac21b2498 req-0772031a-89f7-4499-be52-b36c15e51e65 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:45 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a Jul 03 13:55:45 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:49 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a" returned: 0 in 3.892s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:49 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_cxua78wodevstack@QuobyteHD, size 112.00 MB, duration 3.89 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:55:49 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Converted 112.00 MB image at 28.77 MB/s Jul 03 13:55:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:49 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a 1G Jul 03 13:55:49 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:49 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img" returned: 0 in 4.760s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:49 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18a4104-9f36-493b-b206-dcd00703db38]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:49 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 Jul 03 13:55:49 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:50 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a 1G" returned: 0 in 0.649s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:50 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[27df3b30-33eb-4c91-a018-d791be9e7324]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:50 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a Jul 03 13:55:50 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:50 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471" returned: 0 in 0.895s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:50 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:55:50 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Converted 1024.00 MB image at 215.00 MB/s Jul 03 13:55:50 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] 450ba16a-db75-45a2-a576-d01a10b25c7a was raw, converting to qcow2 {{(pid=86729) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Jul 03 13:55:50 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c114fa-3eae-497b-b0df-00dfeeec7da1]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:50 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img Jul 03 13:55:50 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:50 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a" returned: 0 in 0.736s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:50 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a Jul 03 13:55:50 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:51 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img" returned: 0 in 0.759s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:51 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img Jul 03 13:55:51 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:51 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a" returned: 1 in 0.824s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Downloaded image c72364f8-58c5-4ca3-8348-fe92aceb54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}])) to volume f4c15b9f-0251-4c6b-a516-80787b5db26a successfully. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Temporary image c72364f8-58c5-4ca3-8348-fe92aceb54bd for user 6bb680c9878d40e5b6ae0855a6a4a5c0 is deleted. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Marking volume f4c15b9f-0251-4c6b-a516-80787b5db26a as bootable. {{(pid=86729) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Copying metadata from image c72364f8-58c5-4ca3-8348-fe92aceb54bd to f4c15b9f-0251-4c6b-a516-80787b5db26a. {{(pid=86729) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Creating volume glance metadata for volume f4c15b9f-0251-4c6b-a516-80787b5db26a backed by image c72364f8-58c5-4ca3-8348-fe92aceb54bd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86729) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a554e67-2927-4cf0-8c9d-c116716d0dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c15b9f-0251-4c6b-a516-80787b5db26a', 'volume_size': 1, 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24c8a015e6c74647b59cf3465f3aee9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'created_at': datetime.datetime(2026, 7, 3, 11, 40, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 40, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:51 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e72a3e-d077-44d6-9ec9-b4b09b3be8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img" returned: 1 in 0.742s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img /opt/stack/data/cinder/conversion/vol_upload_2hd3s33a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:51 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Volume volume-f4c15b9f-0251-4c6b-a516-80787b5db26a (f4c15b9f-0251-4c6b-a516-80787b5db26a): created successfully Jul 03 13:55:51 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img /opt/stack/data/cinder/conversion/vol_upload_2hd3s33a Jul 03 13:55:51 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e72a3e-d077-44d6-9ec9-b4b09b3be8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:55:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Flow 'volume_create_manager' (3fe62a39-f806-4b20-9b6b-969f6251e9ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:55:52 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ffeb2fc9-ec9a-4c0f-9ca1-5d19d9622c79 tempest-TestShelveInstance-1236444352 None] Created volume successfully. Jul 03 13:55:52 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img /opt/stack/data/cinder/conversion/vol_upload_2hd3s33a" returned: 0 in 0.639s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:52 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Image conversion details: src /opt/stack/data/cinder/conversion/6ff0d1f4-84fd-4df9-add5-c6071df34471.temp_image.450ba16a-db75-45a2-a576-d01a10b25c7aepi2uq89.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2hd3s33a {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:55:52 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 03 13:55:52 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8927e0-4703-4aaa-b1fb-f53d9fda9157]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2hd3s33a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:52 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2hd3s33a Jul 03 13:55:52 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:53 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2hd3s33a" returned: 0 in 0.745s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.646s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Uploaded volume to glance image-id: 450ba16a-db75-45a2-a576-d01a10b25c7a. {{(pid=86729) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 13:55:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-fa7ec34b-e368-404e-bcbc-89aac21b2498 req-0772031a-89f7-4499-be52-b36c15e51e65 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.055s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:54 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e2be1a-2c7a-426c-b781-dcc3909fcb18]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-fa7ec34b-e368-404e-bcbc-89aac21b2498 req-0772031a-89f7-4499-be52-b36c15e51e65 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:54 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6e6a5f04-a641-441e-bb50-425aa1192716 tempest-VolumesActionsTest-1642662456 None] Copy volume to image completed successfully. Jul 03 13:55:54 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0 Jul 03 13:55:54 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:55 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-fa7ec34b-e368-404e-bcbc-89aac21b2498 req-0772031a-89f7-4499-be52-b36c15e51e65 tempest-AttachVolumeTestJSON-25329155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0" returned: 0 in 0.744s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-fa7ec34b-e368-404e-bcbc-89aac21b2498 req-0772031a-89f7-4499-be52-b36c15e51e65 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.766s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.406s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] Creating offline snapshot a8a83bb5-30ab-49cc-9755-876b9b4b236e of volume 8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:55:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58441e4-2f21-49ef-8af4-35e3a235035e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-fa7ec34b-e368-404e-bcbc-89aac21b2498 req-0772031a-89f7-4499-be52-b36c15e51e65 tempest-AttachVolumeTestJSON-25329155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-02edcb60-253b-47b3-8344-152674e282e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a3bf0d6-d1f2-471d-8a85-2c6594ecad05', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:55:55 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-fa7ec34b-e368-404e-bcbc-89aac21b2498 req-0772031a-89f7-4499-be52-b36c15e51e65 tempest-AttachVolumeTestJSON-25329155 None] attachment_update completed successfully. Jul 03 13:55:55 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:55:55 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Acquiring lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:56 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 0.835s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:55:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:56 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e 1G Jul 03 13:55:56 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Acquiring lock "cinder-quobyte-6ff0d1f4-84fd-4df9-add5-c6071df34471" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Lock "cinder-quobyte-6ff0d1f4-84fd-4df9-add5-c6071df34471" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:56 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad0307-6cf0-4c26-bc71-1b6707176621]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:56 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 Jul 03 13:55:56 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:57 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e 1G" returned: 0 in 0.861s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:57 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471" returned: 0 in 0.788s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:57 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e Jul 03 13:55:57 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:57 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471 Jul 03 13:55:57 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:57 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6ff0d1f4-84fd-4df9-add5-c6071df34471" returned: 0 in 0.644s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Lock "cinder-quobyte-6ff0d1f4-84fd-4df9-add5-c6071df34471" released by "delete_volume" :: held 1.477s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:57 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e" returned: 0 in 0.710s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:57 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e is being set with open permissions: ugo+rw Jul 03 13:55:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:57 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e Jul 03 13:55:57 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:57 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Created reservations ['fee3a0d8-40d8-4d77-8d89-014f81ee8e2b', 'ca7a08ce-3c9b-40c1-aec2-e851c0e88f3a', 'eee1378c-1a80-4926-a865-8932653d70d6', '02f1ee84-65f6-44ef-9476-6dbaa02ebf61'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:55:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:55:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:55:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:58 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:55:58 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:58 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e" returned: 0 in 0.761s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.299s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:55:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-2d5c51e1-dc91-4eb0-b18c-cdf534c56784 tempest-SnapshotsActionsTest-570221400 None] Create snapshot completed successfully Jul 03 13:55:59 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.963s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:55:59 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Deleted volume successfully. Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-42a5be17-197a-48f1-bb47-ed207047db7e tempest-VolumesActionsTest-1642662456 None] Lock "cinder-6ff0d1f4-84fd-4df9-add5-c6071df34471-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Acquiring lock "cinder-a8a83bb5-30ab-49cc-9755-876b9b4b236e-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-a8a83bb5-30ab-49cc-9755-876b9b4b236e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Acquiring lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Acquiring lock "cinder-quobyte-a8a83bb5-30ab-49cc-9755-876b9b4b236e" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-a8a83bb5-30ab-49cc-9755-876b9b4b236e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Deleting offline snapshot a8a83bb5-30ab-49cc-9755-876b9b4b236e of volume 8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] snapshot_file for this snap is: volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[66caf153-bba7-482e-af24-d26d0ae0bb38]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:55:59 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e Jul 03 13:55:59 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-a5e7ed5f-fd18-4d43-9677-e101a07ac899 req-159fd053-9196-4134-9ac5-8aea210d31f8 tempest-TestShelveInstance-1236444352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-a5e7ed5f-fd18-4d43-9677-e101a07ac899 req-159fd053-9196-4134-9ac5-8aea210d31f8 tempest-TestShelveInstance-1236444352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dcf63f-cda1-4a56-8aaf-934fc2c52def]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:55:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-a5e7ed5f-fd18-4d43-9677-e101a07ac899 req-159fd053-9196-4134-9ac5-8aea210d31f8 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:00 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a Jul 03 13:56:00 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:00 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e" returned: 0 in 1.046s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:56:00 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa6863d-dca5-4e26-9a3f-f183da2e9e30]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:00 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:56:00 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:01 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-a5e7ed5f-fd18-4d43-9677-e101a07ac899 req-159fd053-9196-4134-9ac5-8aea210d31f8 tempest-TestShelveInstance-1236444352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a" returned: 0 in 1.125s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-a5e7ed5f-fd18-4d43-9677-e101a07ac899 req-159fd053-9196-4134-9ac5-8aea210d31f8 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:01 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a Jul 03 13:56:01 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:01 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 1.023s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:56:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:01 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e Jul 03 13:56:01 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:01 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-a5e7ed5f-fd18-4d43-9677-e101a07ac899 req-159fd053-9196-4134-9ac5-8aea210d31f8 tempest-TestShelveInstance-1236444352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a" returned: 1 in 0.915s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-a5e7ed5f-fd18-4d43-9677-e101a07ac899 req-159fd053-9196-4134-9ac5-8aea210d31f8 tempest-TestShelveInstance-1236444352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:56:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-a5e7ed5f-fd18-4d43-9677-e101a07ac899 req-159fd053-9196-4134-9ac5-8aea210d31f8 tempest-TestShelveInstance-1236444352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.112s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-a5e7ed5f-fd18-4d43-9677-e101a07ac899 req-159fd053-9196-4134-9ac5-8aea210d31f8 tempest-TestShelveInstance-1236444352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-f4c15b9f-0251-4c6b-a516-80787b5db26a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37cff867-d5ff-47d2-a0ea-5e8cddc39b9c', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:56:02 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-a5e7ed5f-fd18-4d43-9677-e101a07ac899 req-159fd053-9196-4134-9ac5-8aea210d31f8 tempest-TestShelveInstance-1236444352 None] attachment_update completed successfully. Jul 03 13:56:02 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-67c48fb8-05d3-4e43-a125-adbf3658b20e req-3cbef7d2-44db-4c63-9eae-7ba42300674f tempest-AttachVolumeTestJSON-25329155 None] Terminate volume connection completed successfully. Jul 03 13:56:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-67c48fb8-05d3-4e43-a125-adbf3658b20e req-3cbef7d2-44db-4c63-9eae-7ba42300674f tempest-AttachVolumeTestJSON-25329155 None] Deleting attachment 0cea7ba4-c061-49b7-ab01-97021ef02b1f. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:56:02 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e" returned: 0 in 1.168s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:02 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e Jul 03 13:56:02 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:03 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.a8a83bb5-30ab-49cc-9755-876b9b4b236e" returned: 0 in 0.774s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-a8a83bb5-30ab-49cc-9755-876b9b4b236e" released by "_delete_snapshot" :: held 4.197s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" released by "delete_snapshot" :: held 4.256s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:03 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Created reservations ['dcbf6b50-e94d-4e3c-858c-f15ed10f6bcd', '001a1bfe-f690-46c6-8587-5916e4d155a0', '794616de-60eb-4190-a579-c5afa41e6a15', 'ecfd3eb5-debf-4f2b-8075-b10e4e4ce4bc'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:03 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Delete snapshot completed successfully. Jul 03 13:56:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-09b7c4a1-0895-47f1-a911-63231ac7c506 tempest-SnapshotsActionsTest-1797852147 None] Lock "cinder-a8a83bb5-30ab-49cc-9755-876b9b4b236e-delete_snapshot" released by "delete_snapshot" :: held 4.557s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "cinder-7ca2ea71-1c20-4b98-becb-8c8fbb7e5462-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Lock "cinder-7ca2ea71-1c20-4b98-becb-8c8fbb7e5462-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "cinder-quobyte-7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Lock "cinder-quobyte-7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Deleting offline snapshot 7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 of volume 8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:56:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] snapshot_file for this snap is: volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:56:05 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f49204-fd17-4621-9e50-1b2eced88794]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:05 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:56:05 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-35a57598-3337-48c7-9a3e-341d571af913 req-b6d3d1f9-c47c-4bbe-9829-d3fb7932f275 tempest-AttachVolumeTestJSON-25329155 None] Terminate volume connection completed successfully. Jul 03 13:56:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-35a57598-3337-48c7-9a3e-341d571af913 req-b6d3d1f9-c47c-4bbe-9829-d3fb7932f275 tempest-AttachVolumeTestJSON-25329155 None] Deleting attachment 9a3bf0d6-d1f2-471d-8a85-2c6594ecad05. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:56:06 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 0.826s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8637605f-c47c-4e06-9c32-65c3cb858e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e6bfc4-96c1-4276-92c0-f94903f2b634]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:06 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 Jul 03 13:56:06 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Flow 'volume_create_manager' (65d64cd3-b103-4451-9d73-bb8e59d8a898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902f1c82-c1ff-4238-bcda-f2c59f93bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902f1c82-c1ff-4238-bcda-f2c59f93bea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1744354893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9147669a-c2b7-4e14-8620-d5104d92c3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3895b7d6586247088cb6c8e1ab4b980a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:07Z,use_quota=True,user_id='12998c2d0e4343b3a912f7ecf862888a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11df5213-3613-4690-9502-e8082d886bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11df5213-3613-4690-9502-e8082d886bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07997be-463e-490d-9e49-24fe8dae1bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.image.glance [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Creating Keystone auth plugin from conf {{(pid=86729) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07997be-463e-490d-9e49-24fe8dae1bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9147669a-c2b7-4e14-8620-d5104d92c3b0', 'volume_name': 'volume-9147669a-c2b7-4e14-8620-d5104d92c3b0', 'volume_size': 1, 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24c8a015e6c74647b59cf3465f3aee9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'created_at': datetime.datetime(2026, 7, 3, 11, 40, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 40, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79993579-c0b1-4294-9c0b-48bf21dca154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79993579-c0b1-4294-9c0b-48bf21dca154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26002cc-20cb-460b-8eea-cbd39f90bbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:06 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Volume 9147669a-c2b7-4e14-8620-d5104d92c3b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9147669a-c2b7-4e14-8620-d5104d92c3b0', 'volume_size': 1, 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24c8a015e6c74647b59cf3465f3aee9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'created_at': datetime.datetime(2026, 7, 3, 11, 40, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 40, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 13:56:06 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Trying to clone 9147669a-c2b7-4e14-8620-d5104d92c3b0 from image c72364f8-58c5-4ca3-8348-fe92aceb54bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]). {{(pid=86729) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 13:56:06 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65" returned: 0 in 0.906s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:07 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:56:07 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:07 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 13:56:07 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Image download 20.69 MB at 20.69 MB/s Jul 03 13:56:07 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3782eb75-d4fb-43da-901e-351ad2b452b7]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:07 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD Jul 03 13:56:07 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:07 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 0.955s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:07 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462 Jul 03 13:56:07 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:08 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:08 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Temporary image c72364f8-58c5-4ca3-8348-fe92aceb54bd is fetched for user 12998c2d0e4343b3a912f7ecf862888a. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 13:56:08 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57226c2-3787-4a67-8df3-40b3d3543d7a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:08 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD Jul 03 13:56:08 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:08 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-a5e7ed5f-fd18-4d43-9677-e101a07ac899 req-42c6b12f-d108-4f02-9402-37d02a377eab tempest-TestShelveInstance-1236444352 None] Terminate volume connection completed successfully. Jul 03 13:56:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-a5e7ed5f-fd18-4d43-9677-e101a07ac899 req-42c6b12f-d108-4f02-9402-37d02a377eab tempest-TestShelveInstance-1236444352 None] Deleting attachment 37cff867-d5ff-47d2-a0ea-5e8cddc39b9c. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:56:08 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65.7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" returned: 0 in 0.706s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Lock "cinder-quobyte-7ca2ea71-1c20-4b98-becb-8c8fbb7e5462" released by "_delete_snapshot" :: held 3.569s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" released by "delete_snapshot" :: held 3.599s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:08 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Created reservations ['9e526c51-1cc9-4543-a381-a4fa6b41975f', 'de85f315-a520-40f6-a762-06ce428922c8', 'd8ac7292-0321-4b69-839d-13ffc98ea33c', '04231c82-aa07-4705-9bc1-cf2186bd7f60'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:08 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Delete snapshot completed successfully. Jul 03 13:56:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-220781c1-3d82-4b76-ab5e-5fa1116f1b31 tempest-SnapshotsActionsTest-570221400 None] Lock "cinder-7ca2ea71-1c20-4b98-becb-8c8fbb7e5462-delete_snapshot" released by "delete_snapshot" :: held 3.771s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:09 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD" returned: 0 in 0.839s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1744354893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9147669a-c2b7-4e14-8620-d5104d92c3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3895b7d6586247088cb6c8e1ab4b980a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:07Z,use_quota=True,user_id='12998c2d0e4343b3a912f7ecf862888a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Creating volume 9147669a-c2b7-4e14-8620-d5104d92c3b0 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:56:09 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:09 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 1073741824 Jul 03 13:56:09 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "cinder-8637605f-c47c-4e06-9c32-65c3cb858e65-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Lock "cinder-8637605f-c47c-4e06-9c32-65c3cb858e65-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" acquired by "delete_volume" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[909baf5d-8b9d-40c9-922d-82c97f23844e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:09 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 Jul 03 13:56:09 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:10 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 1073741824" returned: 0 in 1.165s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:10 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 Jul 03 13:56:10 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:10 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65" returned: 0 in 0.909s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:10 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65 Jul 03 13:56:10 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:11 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0" returned: 0 in 0.788s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Attempting download of c72364f8-58c5-4ca3-8348-fe92aceb54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}])) to volume 9147669a-c2b7-4e14-8620-d5104d92c3b0. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb43e234-a8c7-4730-b713-a87850464806]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_svo64tfz {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:11 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_svo64tfz Jul 03 13:56:11 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:11 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8637605f-c47c-4e06-9c32-65c3cb858e65" returned: 0 in 0.943s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Lock "cinder-quobyte-8637605f-c47c-4e06-9c32-65c3cb858e65" released by "delete_volume" :: held 1.993s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Created reservations ['fccf6900-05ce-40d3-ab39-adec08ae667a', '45561b4a-345e-48f5-bdcb-8d56bda34e22', '89dd5177-42cc-464c-91b8-60bbf0396831', 'd4fe7392-b926-4ab4-bb9e-cc0ccbf571e3'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:11 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:11 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:12 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_svo64tfz" returned: 0 in 1.029s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_svo64tfz {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:12 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_svo64tfz Jul 03 13:56:12 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:12 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.687s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:12 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:12 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Deleted volume successfully. Jul 03 13:56:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d4989d64-d687-4cb7-b273-ab4097cb8497 tempest-SnapshotsActionsTest-570221400 None] Lock "cinder-8637605f-c47c-4e06-9c32-65c3cb858e65-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:13 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_svo64tfz" returned: 1 in 0.836s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_svo64tfz' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:56:13 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a18089-b3a7-4d7e-bc70-6d3fb3d16751]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:13 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD Jul 03 13:56:13 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:13 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD" returned: 0 in 0.780s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:13 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] c72364f8-58c5-4ca3-8348-fe92aceb54bd was qcow2, converting to raw {{(pid=86729) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 13:56:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:13 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 Jul 03 13:56:13 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Acquiring lock "cinder-f4c15b9f-0251-4c6b-a516-80787b5db26a-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Lock "cinder-f4c15b9f-0251-4c6b-a516-80787b5db26a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Acquiring lock "cinder-quobyte-f4c15b9f-0251-4c6b-a516-80787b5db26a" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Lock "cinder-quobyte-f4c15b9f-0251-4c6b-a516-80787b5db26a" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:14 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2079fc-b8c1-45c9-9d05-2ee077464944]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:15 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a Jul 03 13:56:15 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:16 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a" returned: 0 in 1.197s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:16 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a Jul 03 13:56:16 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0" returned: 0 in 2.606s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:16 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:16 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_ilg71h9ydevstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:56:16 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Converted 112.00 MB image at 42.95 MB/s Jul 03 13:56:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:16 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 1G Jul 03 13:56:16 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "cinder-02edcb60-253b-47b3-8344-152674e282e0-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Lock "cinder-02edcb60-253b-47b3-8344-152674e282e0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "cinder-quobyte-02edcb60-253b-47b3-8344-152674e282e0" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Lock "cinder-quobyte-02edcb60-253b-47b3-8344-152674e282e0" acquired by "delete_volume" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:17 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a" returned: 1 in 1.107s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:56:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:17 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac455899-a228-4f1b-9dab-e289265954d3]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:17 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a Jul 03 13:56:17 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:17 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0 Jul 03 13:56:17 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:17 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 1G" returned: 0 in 1.106s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:17 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac82293e-42a9-40b1-a0fc-f9edce64fcea]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:17 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 Jul 03 13:56:17 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:18 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f4c15b9f-0251-4c6b-a516-80787b5db26a" returned: 0 in 0.801s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Lock "cinder-quobyte-f4c15b9f-0251-4c6b-a516-80787b5db26a" released by "delete_volume" :: held 3.203s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG cinder.quota [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Created reservations ['d7006612-ce32-4a60-8615-a9fb0048dcce', '296c6eb1-3c1d-4f9d-bb13-5da49049ae06', 'edcd492b-1bb4-4849-8b86-6872d2a77ab5', 'b445ccd7-edaf-4e65-8fa6-99c4e9478bd0'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:18 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:18 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:18 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0" returned: 0 in 1.324s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:18 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0 Jul 03 13:56:18 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:18 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0" returned: 0 in 1.159s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:18 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 Jul 03 13:56:19 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:19 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.155s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG cinder.manager [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:19 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Deleted volume successfully. Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [req-df0ea844-13d9-4fb2-9501-f7c7d35382f7 req-090a859f-1642-41c7-91d6-4e81efb23de0 tempest-TestShelveInstance-1236444352 None] Lock "cinder-f4c15b9f-0251-4c6b-a516-80787b5db26a-delete_volume" released by "delete_volume" :: held 4.666s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:19 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-02edcb60-253b-47b3-8344-152674e282e0" returned: 0 in 0.981s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Lock "cinder-quobyte-02edcb60-253b-47b3-8344-152674e282e0" released by "delete_volume" :: held 2.363s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Created reservations ['b08e5ac8-f53d-4dbd-9c30-ba1c27c83b74', '7ece5ba1-d2e5-4781-8dec-ccf948173875', '4dd9508e-ee58-4273-815c-da04f17f5fff', 'b8643a0c-8f0c-4bb8-b9c1-3b137db62dc7'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:19 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0" returned: 1 in 1.044s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Downloaded image c72364f8-58c5-4ca3-8348-fe92aceb54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}])) to volume 9147669a-c2b7-4e14-8620-d5104d92c3b0 successfully. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Temporary image c72364f8-58c5-4ca3-8348-fe92aceb54bd for user 12998c2d0e4343b3a912f7ecf862888a is deleted. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Marking volume 9147669a-c2b7-4e14-8620-d5104d92c3b0 as bootable. {{(pid=86729) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 13:56:19 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:19 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Copying metadata from image c72364f8-58c5-4ca3-8348-fe92aceb54bd to 9147669a-c2b7-4e14-8620-d5104d92c3b0. {{(pid=86729) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 13:56:19 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Creating volume glance metadata for volume 9147669a-c2b7-4e14-8620-d5104d92c3b0 backed by image c72364f8-58c5-4ca3-8348-fe92aceb54bd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86729) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26002cc-20cb-460b-8eea-cbd39f90bbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9147669a-c2b7-4e14-8620-d5104d92c3b0', 'volume_size': 1, 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24c8a015e6c74647b59cf3465f3aee9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'created_at': datetime.datetime(2026, 7, 3, 11, 40, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 40, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda09148-0601-42f8-b7d1-5a2436b17e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:20 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Volume volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 (9147669a-c2b7-4e14-8620-d5104d92c3b0): created successfully Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda09148-0601-42f8-b7d1-5a2436b17e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Flow 'volume_create_manager' (65d64cd3-b103-4451-9d73-bb8e59d8a898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:20 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-11be5528-b79e-4ce7-832c-7330ade16794 tempest-VolumesExtendTest-913355309 None] Created volume successfully. Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "cinder-2b09f008-492a-44fa-8bca-aad0d9a859d9-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Lock "cinder-2b09f008-492a-44fa-8bca-aad0d9a859d9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Flow 'volume_create_manager' (89037a25-9e13-4db1-a644-b49a0036e8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d7ae7f-fca9-40a1-9b21-e925ba0865cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d7ae7f-fca9-40a1-9b21-e925ba0865cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-293563394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75a12e0-64e4-405e-8fd3-e2ca50f5da85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acb72a7c47aa46dc8cfd75e6eebf6cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:21Z,use_quota=True,user_id='a347b02029f3407e81b9fb08117ebba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4e44e3-a008-4ea6-a742-137946c94212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:20 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4e44e3-a008-4ea6-a742-137946c94212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b07292-d4fc-4eef-9c43-da03addd36ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b07292-d4fc-4eef-9c43-da03addd36ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75a12e0-64e4-405e-8fd3-e2ca50f5da85', 'volume_name': 'volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc78c1c7-a703-452b-927d-068e71b7d9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc78c1c7-a703-452b-927d-068e71b7d9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48db5c4-21fe-4776-8fd6-01b07c0977fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:20 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Volume f75a12e0-64e4-405e-8fd3-e2ca50f5da85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85', 'volume_size': 1} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-293563394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75a12e0-64e4-405e-8fd3-e2ca50f5da85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acb72a7c47aa46dc8cfd75e6eebf6cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:21Z,use_quota=True,user_id='a347b02029f3407e81b9fb08117ebba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Creating volume f75a12e0-64e4-405e-8fd3-e2ca50f5da85 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:56:20 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.925s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:20 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 1073741824 Jul 03 13:56:20 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:20 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Deleted volume successfully. Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "cinder-quobyte-2b09f008-492a-44fa-8bca-aad0d9a859d9" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Lock "cinder-quobyte-2b09f008-492a-44fa-8bca-aad0d9a859d9" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9be98a44-cd2a-4b0c-9892-07bdfa93a07c tempest-AttachVolumeTestJSON-25329155 None] Lock "cinder-02edcb60-253b-47b3-8344-152674e282e0-delete_volume" released by "delete_volume" :: held 3.658s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dd7953-daff-49ce-855c-3d001d8f88e9]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:20 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9 Jul 03 13:56:20 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5720149-5fa0-4f17-8f80-f6f654964bde tempest-VolumesExtendTest-913355309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:21 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9" returned: 0 in 0.912s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:21 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9 Jul 03 13:56:21 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:22 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 1073741824" returned: 0 in 1.250s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:22 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 Jul 03 13:56:22 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:22 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2b09f008-492a-44fa-8bca-aad0d9a859d9" returned: 0 in 0.725s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Lock "cinder-quobyte-2b09f008-492a-44fa-8bca-aad0d9a859d9" released by "delete_volume" :: held 1.685s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Created reservations ['f4bde859-c64c-4a6d-b210-4113ef62c5c8', '7b67d5f2-3edc-455e-8e87-bc1bc0c42702', '20f0c1ba-dd18-4554-bf48-2d5ee105f328', '89c6ffa1-a19e-4929-ac36-b2d1ccc04ef3'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:22 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:22 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:22 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85" returned: 0 in 0.759s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5720149-5fa0-4f17-8f80-f6f654964bde tempest-VolumesExtendTest-913355309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.531s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48db5c4-21fe-4776-8fd6-01b07c0977fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d394c0-5b2d-4661-b23c-c981fd640488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:22 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Volume volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 (f75a12e0-64e4-405e-8fd3-e2ca50f5da85): created successfully Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d394c0-5b2d-4661-b23c-c981fd640488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Flow 'volume_create_manager' (89037a25-9e13-4db1-a644-b49a0036e8da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[063ad4e9-d329-4eef-ac34-76c4f389d7f5]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5720149-5fa0-4f17-8f80-f6f654964bde tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:22 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ff6faafa-5e32-4f49-ae34-1a58902742a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Created volume successfully. Jul 03 13:56:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "cinder-2a036267-6519-4e13-af20-80679ce5c5c2-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:23 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 Jul 03 13:56:23 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Lock "cinder-2a036267-6519-4e13-af20-80679ce5c5c2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "cinder-quobyte-2a036267-6519-4e13-af20-80679ce5c5c2" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Lock "cinder-quobyte-2a036267-6519-4e13-af20-80679ce5c5c2" acquired by "delete_volume" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b25a137-b85a-4cef-b6ad-1785e5e12a17]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:23 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2 Jul 03 13:56:23 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:23 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.803s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:23 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:23 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Deleted volume successfully. Jul 03 13:56:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-10896b2b-80cc-46f0-a65f-2bff45bc32f2 tempest-AttachVolumeTestJSON-25329155 None] Lock "cinder-2b09f008-492a-44fa-8bca-aad0d9a859d9-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:23 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5720149-5fa0-4f17-8f80-f6f654964bde tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0" returned: 0 in 1.044s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5720149-5fa0-4f17-8f80-f6f654964bde tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:24 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 Jul 03 13:56:24 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:24 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2" returned: 0 in 0.944s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:24 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2 Jul 03 13:56:24 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:24 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5720149-5fa0-4f17-8f80-f6f654964bde tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0" returned: 1 in 0.871s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5720149-5fa0-4f17-8f80-f6f654964bde tempest-VolumesExtendTest-913355309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:56:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5720149-5fa0-4f17-8f80-f6f654964bde tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 2G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:24 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2a036267-6519-4e13-af20-80679ce5c5c2" returned: 0 in 0.710s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:24 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Lock "cinder-quobyte-2a036267-6519-4e13-af20-80679ce5c5c2" released by "delete_volume" :: held 1.730s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5720149-5fa0-4f17-8f80-f6f654964bde tempest-VolumesExtendTest-913355309 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 2G" returned: 0 in 0.074s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5720149-5fa0-4f17-8f80-f6f654964bde tempest-VolumesExtendTest-913355309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.066s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.845s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Creating offline snapshot 60a04c8f-4097-4d90-9d0a-6d58889f14ad of volume f75a12e0-64e4-405e-8fd3-e2ca50f5da85 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d71c7cc-8bfd-4a08-9d53-93ea3d8b3dda]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:25 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e5720149-5fa0-4f17-8f80-f6f654964bde tempest-VolumesExtendTest-913355309 None] Extend volume completed successfully. Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Created reservations ['68491077-a5e6-48da-83b1-6f81aac48939', 'dcea9377-b0dd-4bfb-883f-cf5a05de229c', 'fc45b787-7146-4af7-9344-76fd690a6777', 'ac9a2f86-bd75-4e42-b7d2-8ddb6230cdfc'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:25 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 Jul 03 13:56:25 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:25 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:25 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:25 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:25 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Acquiring lock "cinder-9147669a-c2b7-4e14-8620-d5104d92c3b0-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:26 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Lock "cinder-9147669a-c2b7-4e14-8620-d5104d92c3b0-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.976s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:26 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Deleted volume successfully. Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00a917fc-e041-4921-9c7b-91725adb0d99 tempest-AttachVolumeTestJSON-25329155 None] Lock "cinder-2a036267-6519-4e13-af20-80679ce5c5c2-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Acquiring lock "cinder-quobyte-9147669a-c2b7-4e14-8620-d5104d92c3b0" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Lock "cinder-quobyte-9147669a-c2b7-4e14-8620-d5104d92c3b0" acquired by "delete_volume" :: waited 0.032s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:26 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85" returned: 0 in 1.325s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17a5e3c-6edf-4fbe-9486-da0c9cf7ca17]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:26 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad 1G Jul 03 13:56:26 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:26 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 Jul 03 13:56:26 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:26 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.960s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:27 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad 1G" returned: 0 in 0.963s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:27 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad Jul 03 13:56:27 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:27 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0" returned: 0 in 1.324s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:27 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 Jul 03 13:56:27 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:28 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad" returned: 0 in 0.862s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:28 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad is being set with open permissions: ugo+rw Jul 03 13:56:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:28 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad Jul 03 13:56:28 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:28 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0" returned: 1 in 1.066s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:56:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:28 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0 Jul 03 13:56:28 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:29 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad" returned: 0 in 0.848s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:29 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.info Jul 03 13:56:29 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:29 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9147669a-c2b7-4e14-8620-d5104d92c3b0" returned: 0 in 0.860s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Lock "cinder-quobyte-9147669a-c2b7-4e14-8620-d5104d92c3b0" released by "delete_volume" :: held 3.359s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Created reservations ['2cbd1c83-d103-4cc0-9a57-910dc00e80bc', '254cf2db-e285-4d12-b24b-7ef5e885e2c8', '79c1fad7-bc32-4897-8a05-31fb32adb742', '0097c2b7-4336-478e-9d2a-858b5504725c'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:29 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:29 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:29 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.info" returned: 0 in 0.923s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:29 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.info is being set with open permissions: ugo+rw Jul 03 13:56:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:30 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.info Jul 03 13:56:30 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:30 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.967s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:30 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:30 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Deleted volume successfully. Jul 03 13:56:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-cea6ca6b-6201-4f3a-93fd-de854a873212 tempest-VolumesExtendTest-913355309 None] Lock "cinder-9147669a-c2b7-4e14-8620-d5104d92c3b0-delete_volume" released by "delete_volume" :: held 4.722s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:31 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.info" returned: 0 in 1.015s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.143s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:31 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a4606396-c188-479b-9d26-e0b980c325d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Create snapshot completed successfully Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Flow 'volume_create_manager' (cef9b77d-e892-40b7-b0d2-42066603cb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681d5a1d-54db-4aa6-be33-45a295fcc8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681d5a1d-54db-4aa6-be33-45a295fcc8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1839417837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fe1caf-42fc-4f89-b829-ecc1a414b519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3895b7d6586247088cb6c8e1ab4b980a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:31Z,use_quota=True,user_id='12998c2d0e4343b3a912f7ecf862888a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a59871-b294-4c87-84d0-44bc481dcd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a59871-b294-4c87-84d0-44bc481dcd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdbf12a-07e6-416f-869a-cf34d67d4302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdbf12a-07e6-416f-869a-cf34d67d4302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4fe1caf-42fc-4f89-b829-ecc1a414b519', 'volume_name': 'volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c900ccb-cc7d-4702-9aa9-4b5a13bf3bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c900ccb-cc7d-4702-9aa9-4b5a13bf3bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1042eac3-4b5d-4639-9a49-a0a21b99181c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:31 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Volume e4fe1caf-42fc-4f89-b829-ecc1a414b519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519', 'volume_size': 1} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1839417837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fe1caf-42fc-4f89-b829-ecc1a414b519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3895b7d6586247088cb6c8e1ab4b980a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:31Z,use_quota=True,user_id='12998c2d0e4343b3a912f7ecf862888a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Creating volume e4fe1caf-42fc-4f89-b829-ecc1a414b519 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:56:31 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:56:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:31 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 1073741824 Jul 03 13:56:31 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Acquiring lock "cinder-60a04c8f-4097-4d90-9d0a-6d58889f14ad-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "cinder-60a04c8f-4097-4d90-9d0a-6d58889f14ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Acquiring lock "cinder-quobyte-f75a12e0-64e4-405e-8fd3-e2ca50f5da85" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "cinder-quobyte-f75a12e0-64e4-405e-8fd3-e2ca50f5da85" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Acquiring lock "cinder-quobyte-60a04c8f-4097-4d90-9d0a-6d58889f14ad" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Flow 'volume_create_manager' (aa30f35d-9784-450e-83fb-ea95e468f7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d480a7c-9e14-46b6-b1e1-378a8c020bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "cinder-quobyte-60a04c8f-4097-4d90-9d0a-6d58889f14ad" acquired by "_delete_snapshot" :: waited 0.115s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Deleting offline snapshot 60a04c8f-4097-4d90-9d0a-6d58889f14ad of volume f75a12e0-64e4-405e-8fd3-e2ca50f5da85 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] snapshot_file for this snap is: volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d480a7c-9e14-46b6-b1e1-378a8c020bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1369204276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a867445-93c3-414f-ae61-10347ad88661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39506307810749089f97f2146c5e46bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:32Z,use_quota=True,user_id='4f6fbd2febf74b97a146bad76b9f27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfacb300-8987-4e5b-ab98-bd3353f84e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfacb300-8987-4e5b-ab98-bd3353f84e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4d1294-aae4-4463-87ed-fe0f47aaac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4d1294-aae4-4463-87ed-fe0f47aaac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a867445-93c3-414f-ae61-10347ad88661', 'volume_name': 'volume-4a867445-93c3-414f-ae61-10347ad88661', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea39c44-00b4-4a55-8cf2-e2c6c67884e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea39c44-00b4-4a55-8cf2-e2c6c67884e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8800ff16-b389-49ed-9c23-529290404ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:32 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Volume 4a867445-93c3-414f-ae61-10347ad88661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a867445-93c3-414f-ae61-10347ad88661', 'volume_size': 1} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c785de-21d5-4e4d-be7c-6f83e19bd8c8]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:32 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad Jul 03 13:56:32 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Flow 'volume_create_manager' (9843644f-93b5-4abb-9b29-d31bdc1384b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142892b9-0a9f-4a68-af7a-33556214257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142892b9-0a9f-4a68-af7a-33556214257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-322787156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ca2c81-343f-4ffb-85db-4daa856d4fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39506307810749089f97f2146c5e46bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:33Z,use_quota=True,user_id='4f6fbd2febf74b97a146bad76b9f27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3374c0d5-c48b-477f-82c9-59944e1a640f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3374c0d5-c48b-477f-82c9-59944e1a640f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abe2814-af22-40ed-b0bc-593c50abe893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abe2814-af22-40ed-b0bc-593c50abe893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ca2c81-343f-4ffb-85db-4daa856d4fe6', 'volume_name': 'volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a14a6d-56e6-46da-be2b-5e1e765950e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a14a6d-56e6-46da-be2b-5e1e765950e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1642fad6-724e-431b-9961-7e201aeef209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:32 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Volume b1ca2c81-343f-4ffb-85db-4daa856d4fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6', 'volume_size': 1} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:32 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 1073741824" returned: 0 in 1.308s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:32 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 Jul 03 13:56:32 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Flow 'volume_create_manager' (dc23edf5-a92a-43cb-8244-eda17dbfaebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d073f692-675c-447b-bbfc-c086ee163db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d073f692-675c-447b-bbfc-c086ee163db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1237136897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621137e5-62d1-43a3-8fd4-aa83607932f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39506307810749089f97f2146c5e46bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:33Z,use_quota=True,user_id='4f6fbd2febf74b97a146bad76b9f27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde20472-1489-492f-9e3b-ad24a2e8fd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde20472-1489-492f-9e3b-ad24a2e8fd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45b5d79-0683-4755-a97d-61bbdf8046f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45b5d79-0683-4755-a97d-61bbdf8046f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621137e5-62d1-43a3-8fd4-aa83607932f1', 'volume_name': 'volume-621137e5-62d1-43a3-8fd4-aa83607932f1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108a4a2c-eb4a-45b3-9c5e-bb9a42dd9c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108a4a2c-eb4a-45b3-9c5e-bb9a42dd9c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655a645a-09d2-4a77-a86d-68c068ff1622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:33 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Volume 621137e5-62d1-43a3-8fd4-aa83607932f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621137e5-62d1-43a3-8fd4-aa83607932f1', 'volume_size': 1} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Flow 'volume_create_manager' (cc1dfd72-286a-428f-ac5f-da6191dc8ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbf5571-3b90-4742-a393-7f0380210379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:33 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbf5571-3b90-4742-a393-7f0380210379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546700330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131be871-62e1-4c07-bf79-c29bebfc3288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39506307810749089f97f2146c5e46bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:34Z,use_quota=True,user_id='4f6fbd2febf74b97a146bad76b9f27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073b2ec5-12f2-475c-bf8d-a52bdca6b622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073b2ec5-12f2-475c-bf8d-a52bdca6b622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd7b3c3-3bb7-45de-b02d-b8611a123165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd7b3c3-3bb7-45de-b02d-b8611a123165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '131be871-62e1-4c07-bf79-c29bebfc3288', 'volume_name': 'volume-131be871-62e1-4c07-bf79-c29bebfc3288', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6fe4a5-d14b-4158-b88f-a177434d510a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6fe4a5-d14b-4158-b88f-a177434d510a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5adea55-eb0e-44af-a11e-45b0ca3160e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:33 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Volume 131be871-62e1-4c07-bf79-c29bebfc3288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-131be871-62e1-4c07-bf79-c29bebfc3288', 'volume_size': 1} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad" returned: 0 in 1.388s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0bf35c-15f0-44f4-bc42-89c2292ab64e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:33 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519" returned: 0 in 1.024s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] <== create_volume: return (2422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.424s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.522s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1369204276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a867445-93c3-414f-ae61-10347ad88661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39506307810749089f97f2146c5e46bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:32Z,use_quota=True,user_id='4f6fbd2febf74b97a146bad76b9f27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Creating volume 4a867445-93c3-414f-ae61-10347ad88661 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:56:33 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:56:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a867445-93c3-414f-ae61-10347ad88661 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:34 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a867445-93c3-414f-ae61-10347ad88661 1073741824 Jul 03 13:56:34 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1042eac3-4b5d-4639-9a49-a0a21b99181c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:34 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 Jul 03 13:56:34 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f95d66-2efc-438d-9b19-5bb388fc0956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:34 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Volume volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 (e4fe1caf-42fc-4f89-b829-ecc1a414b519): created successfully Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f95d66-2efc-438d-9b19-5bb388fc0956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Flow 'volume_create_manager' (cef9b77d-e892-40b7-b0d2-42066603cb7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-302fe20d-7989-4a36-9a78-33a33770603d tempest-VolumesExtendTest-913355309 None] Created volume successfully. Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Flow 'volume_create_manager' (8b7e8f42-b1ab-47ac-93d7-6c403a594657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b52709-8a96-46b2-b8bd-4800ea2387a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b52709-8a96-46b2-b8bd-4800ea2387a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2058060153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b895de79-cd65-488c-adef-e026be7f23c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39506307810749089f97f2146c5e46bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:34Z,use_quota=True,user_id='4f6fbd2febf74b97a146bad76b9f27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24ffcf3-d53c-4352-9df0-685fc20d7004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24ffcf3-d53c-4352-9df0-685fc20d7004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f0df99-6f5f-44e3-9acc-910617061df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f0df99-6f5f-44e3-9acc-910617061df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b895de79-cd65-488c-adef-e026be7f23c3', 'volume_name': 'volume-b895de79-cd65-488c-adef-e026be7f23c3', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3740b33-99af-4565-82bf-f1087b5deceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3740b33-99af-4565-82bf-f1087b5deceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9982ecfd-88bb-4287-93ec-bd3c16c58b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:34 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Volume b895de79-cd65-488c-adef-e026be7f23c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b895de79-cd65-488c-adef-e026be7f23c3', 'volume_size': 1} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:34 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85" returned: 0 in 1.004s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:34 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad Jul 03 13:56:34 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:35 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a867445-93c3-414f-ae61-10347ad88661 1073741824" returned: 0 in 1.173s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a867445-93c3-414f-ae61-10347ad88661 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:35 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a867445-93c3-414f-ae61-10347ad88661 Jul 03 13:56:35 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:35 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad" returned: 0 in 0.917s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:35 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad Jul 03 13:56:35 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:36 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a867445-93c3-414f-ae61-10347ad88661" returned: 0 in 0.828s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.252s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-322787156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ca2c81-343f-4ffb-85db-4daa856d4fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39506307810749089f97f2146c5e46bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:33Z,use_quota=True,user_id='4f6fbd2febf74b97a146bad76b9f27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Creating volume b1ca2c81-343f-4ffb-85db-4daa856d4fe6 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:56:36 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=98,cinder:SELECT=109,cinder:DELETE=7,cinder:INSERT=35 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8800ff16-b389-49ed-9c23-529290404ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a867445-93c3-414f-ae61-10347ad88661', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2ad448-0a55-479b-a413-e36bda080134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=99,cinder:UPDATE=110,cinder:DELETE=8,cinder:INSERT=37 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:56:36 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6 1073741824 Jul 03 13:56:36 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:36 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Volume volume-4a867445-93c3-414f-ae61-10347ad88661 (4a867445-93c3-414f-ae61-10347ad88661): created successfully Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2ad448-0a55-479b-a413-e36bda080134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Flow 'volume_create_manager' (aa30f35d-9784-450e-83fb-ea95e468f7f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:36 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e333363d-aa30-4979-bda5-b986331f2e51 tempest-CreateVolumesFromImageTest-267216533 None] Created volume successfully. Jul 03 13:56:36 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85.60a04c8f-4097-4d90-9d0a-6d58889f14ad" returned: 0 in 0.928s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "cinder-quobyte-60a04c8f-4097-4d90-9d0a-6d58889f14ad" released by "_delete_snapshot" :: held 4.423s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "cinder-quobyte-f75a12e0-64e4-405e-8fd3-e2ca50f5da85" released by "delete_snapshot" :: held 4.549s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Created reservations ['c422d060-3eca-40ed-98da-b44931b4b405', 'c3229c78-267a-4cc5-8cff-09d118089615', '0f333684-772f-4e8d-8776-3521f9ce193e', 'f5879d35-840e-4ed1-9848-cce80f18812a'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:36 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Delete snapshot completed successfully. Jul 03 13:56:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b381f1cc-3890-4b8c-8039-e0bb54462fdf tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "cinder-60a04c8f-4097-4d90-9d0a-6d58889f14ad-delete_snapshot" released by "delete_snapshot" :: held 4.761s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:37 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6 1073741824" returned: 0 in 0.984s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:37 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6 Jul 03 13:56:37 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Acquiring lock "cinder-f75a12e0-64e4-405e-8fd3-e2ca50f5da85-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "cinder-f75a12e0-64e4-405e-8fd3-e2ca50f5da85-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Acquiring lock "cinder-quobyte-f75a12e0-64e4-405e-8fd3-e2ca50f5da85" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "cinder-quobyte-f75a12e0-64e4-405e-8fd3-e2ca50f5da85" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56058a4-eb83-4127-a488-fcbff654b40b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:37 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 Jul 03 13:56:37 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:37 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6" returned: 0 in 0.784s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.603s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1237136897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621137e5-62d1-43a3-8fd4-aa83607932f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39506307810749089f97f2146c5e46bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:33Z,use_quota=True,user_id='4f6fbd2febf74b97a146bad76b9f27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Creating volume 621137e5-62d1-43a3-8fd4-aa83607932f1 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:56:37 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-621137e5-62d1-43a3-8fd4-aa83607932f1 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1642fad6-724e-431b-9961-7e201aeef209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:37 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-621137e5-62d1-43a3-8fd4-aa83607932f1 1073741824 Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3eb71c-7dc5-4512-8aa8-0258cfce5d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:37 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:37 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Volume volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6 (b1ca2c81-343f-4ffb-85db-4daa856d4fe6): created successfully Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3eb71c-7dc5-4512-8aa8-0258cfce5d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Flow 'volume_create_manager' (9843644f-93b5-4abb-9b29-d31bdc1384b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:37 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6db96414-5491-4910-b501-a5f52d708be3 tempest-CreateVolumesFromImageTest-267216533 None] Created volume successfully. Jul 03 13:56:38 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85" returned: 0 in 0.841s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:38 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85 Jul 03 13:56:38 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:38 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-621137e5-62d1-43a3-8fd4-aa83607932f1 1073741824" returned: 0 in 1.044s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-621137e5-62d1-43a3-8fd4-aa83607932f1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:39 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-621137e5-62d1-43a3-8fd4-aa83607932f1 Jul 03 13:56:39 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:39 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f75a12e0-64e4-405e-8fd3-e2ca50f5da85" returned: 0 in 0.794s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "cinder-quobyte-f75a12e0-64e4-405e-8fd3-e2ca50f5da85" released by "delete_volume" :: held 1.718s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Created reservations ['d3070838-5ee4-428f-9148-4ee2d2aa4083', 'e58fbb5d-0944-4acf-91ac-f591b41a62f0', 'a1151ee4-3d50-44d7-81c4-bd1ce81c6337', '1cbe88ec-4350-43f6-99c4-f464b2b6a79d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:39 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:39 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:39 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-621137e5-62d1-43a3-8fd4-aa83607932f1" returned: 0 in 0.708s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.868s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546700330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131be871-62e1-4c07-bf79-c29bebfc3288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39506307810749089f97f2146c5e46bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:34Z,use_quota=True,user_id='4f6fbd2febf74b97a146bad76b9f27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Creating volume 131be871-62e1-4c07-bf79-c29bebfc3288 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:56:39 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-131be871-62e1-4c07-bf79-c29bebfc3288 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:39 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-131be871-62e1-4c07-bf79-c29bebfc3288 1073741824 Jul 03 13:56:39 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655a645a-09d2-4a77-a86d-68c068ff1622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621137e5-62d1-43a3-8fd4-aa83607932f1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6e9786-913b-4a5c-bc82-463dc41cdeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:39 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Volume volume-621137e5-62d1-43a3-8fd4-aa83607932f1 (621137e5-62d1-43a3-8fd4-aa83607932f1): created successfully Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6e9786-913b-4a5c-bc82-463dc41cdeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Flow 'volume_create_manager' (dc23edf5-a92a-43cb-8244-eda17dbfaebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:39 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1c8c307d-41c6-493c-8e5e-277e109d14b4 tempest-CreateVolumesFromImageTest-267216533 None] Created volume successfully. Jul 03 13:56:40 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.824s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:40 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:40 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Deleted volume successfully. Jul 03 13:56:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e519e1b7-15a8-4f4f-863d-c81257007e71 tempest-VolumeSnapshotQuotasNegativeTestJSON-2069235147 None] Lock "cinder-f75a12e0-64e4-405e-8fd3-e2ca50f5da85-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:40 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-131be871-62e1-4c07-bf79-c29bebfc3288 1073741824" returned: 0 in 1.175s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-131be871-62e1-4c07-bf79-c29bebfc3288 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:40 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-131be871-62e1-4c07-bf79-c29bebfc3288 Jul 03 13:56:40 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:41 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-131be871-62e1-4c07-bf79-c29bebfc3288" returned: 0 in 0.682s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.273s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2058060153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b895de79-cd65-488c-adef-e026be7f23c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39506307810749089f97f2146c5e46bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:56:34Z,use_quota=True,user_id='4f6fbd2febf74b97a146bad76b9f27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Creating volume b895de79-cd65-488c-adef-e026be7f23c3 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:56:41 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b895de79-cd65-488c-adef-e026be7f23c3 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5adea55-eb0e-44af-a11e-45b0ca3160e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131be871-62e1-4c07-bf79-c29bebfc3288', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:41 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b895de79-cd65-488c-adef-e026be7f23c3 1073741824 Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3aa23da-ecd3-4f5e-8e1d-3751c147813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:41 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:41 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Volume volume-131be871-62e1-4c07-bf79-c29bebfc3288 (131be871-62e1-4c07-bf79-c29bebfc3288): created successfully Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3aa23da-ecd3-4f5e-8e1d-3751c147813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Flow 'volume_create_manager' (cc1dfd72-286a-428f-ac5f-da6191dc8ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:41 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9658cad1-9380-4b32-a156-c30bc9879ffd tempest-CreateVolumesFromImageTest-267216533 None] Created volume successfully. Jul 03 13:56:42 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b895de79-cd65-488c-adef-e026be7f23c3 1073741824" returned: 0 in 1.076s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b895de79-cd65-488c-adef-e026be7f23c3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:42 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b895de79-cd65-488c-adef-e026be7f23c3 Jul 03 13:56:42 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:43 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b895de79-cd65-488c-adef-e026be7f23c3" returned: 0 in 0.873s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:56:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.863s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] Creating offline snapshot 4a75aec1-efe8-4b48-9a4e-6075d325335f of volume e4fe1caf-42fc-4f89-b829-ecc1a414b519 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:56:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9982ecfd-88bb-4287-93ec-bd3c16c58b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b895de79-cd65-488c-adef-e026be7f23c3', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f412450-a0b4-4ec0-a1f7-eb054252163b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:56:43 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d27f26-f7cd-4bd1-b878-f32bf32c089c]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:43 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Volume volume-b895de79-cd65-488c-adef-e026be7f23c3 (b895de79-cd65-488c-adef-e026be7f23c3): created successfully Jul 03 13:56:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f412450-a0b4-4ec0-a1f7-eb054252163b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:56:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Flow 'volume_create_manager' (8b7e8f42-b1ab-47ac-93d7-6c403a594657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:56:43 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-83c5787c-430a-4ab8-9b9a-4e66c46ee921 tempest-CreateVolumesFromImageTest-267216533 None] Created volume successfully. Jul 03 13:56:43 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 Jul 03 13:56:43 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "cinder-b895de79-cd65-488c-adef-e026be7f23c3-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-b895de79-cd65-488c-adef-e026be7f23c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "cinder-quobyte-b895de79-cd65-488c-adef-e026be7f23c3" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-quobyte-b895de79-cd65-488c-adef-e026be7f23c3" acquired by "delete_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:44 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbf3a13-0cc8-4c57-9732-ec3af0cb148d]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b895de79-cd65-488c-adef-e026be7f23c3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:44 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519" returned: 0 in 1.010s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:44 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f 1G Jul 03 13:56:44 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:44 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b895de79-cd65-488c-adef-e026be7f23c3 Jul 03 13:56:44 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:45 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b895de79-cd65-488c-adef-e026be7f23c3" returned: 0 in 1.182s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b895de79-cd65-488c-adef-e026be7f23c3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:45 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f 1G" returned: 0 in 1.084s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:45 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b895de79-cd65-488c-adef-e026be7f23c3 Jul 03 13:56:45 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:45 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f Jul 03 13:56:45 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:46 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b895de79-cd65-488c-adef-e026be7f23c3" returned: 0 in 0.785s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-quobyte-b895de79-cd65-488c-adef-e026be7f23c3" released by "delete_volume" :: held 2.044s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:46 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f" returned: 0 in 0.881s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:46 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f is being set with open permissions: ugo+rw Jul 03 13:56:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:46 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f Jul 03 13:56:46 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:46 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Created reservations ['524426bd-57da-450c-a2ca-bd35fd19c340', 'b7d6851d-1df0-4e8a-9d8c-cf9c6ec24231', '7d28b679-fa8f-4faa-8b32-9440c136a2bc', '4c8e1ca6-7498-437b-b2b3-f8479e87f00d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:46 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:46 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:47 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f" returned: 0 in 1.031s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:47 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.918s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:47 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:47 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Deleted volume successfully. Jul 03 13:56:47 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.info Jul 03 13:56:47 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-94c1afa5-e7bb-4687-84f4-3eefe66c30a9 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-b895de79-cd65-488c-adef-e026be7f23c3-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "cinder-131be871-62e1-4c07-bf79-c29bebfc3288-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-131be871-62e1-4c07-bf79-c29bebfc3288-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "cinder-quobyte-131be871-62e1-4c07-bf79-c29bebfc3288" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-quobyte-131be871-62e1-4c07-bf79-c29bebfc3288" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:48 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd6d73-b513-4330-86da-4e1ea2b33334]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-131be871-62e1-4c07-bf79-c29bebfc3288 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:48 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-131be871-62e1-4c07-bf79-c29bebfc3288 Jul 03 13:56:48 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:48 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.info" returned: 0 in 0.966s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:48 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.info is being set with open permissions: ugo+rw Jul 03 13:56:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:48 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.info Jul 03 13:56:48 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:49 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-131be871-62e1-4c07-bf79-c29bebfc3288" returned: 0 in 1.100s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-131be871-62e1-4c07-bf79-c29bebfc3288 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:49 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-131be871-62e1-4c07-bf79-c29bebfc3288 Jul 03 13:56:49 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:49 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.info" returned: 0 in 1.021s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.144s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:49 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a599d393-dc33-42cf-a90b-615069ebaf2d tempest-VolumesExtendTest-913355309 None] Create snapshot completed successfully Jul 03 13:56:49 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-131be871-62e1-4c07-bf79-c29bebfc3288" returned: 0 in 0.808s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-quobyte-131be871-62e1-4c07-bf79-c29bebfc3288" released by "delete_volume" :: held 1.958s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Created reservations ['8122590d-91ee-4df7-91ad-5c47b3a383c2', 'aaa4b4f9-8c11-4847-a6d5-9958ee929495', '0fffed63-9c75-4991-8a13-130fc209cedb', '1ba69b80-a379-4031-8c83-d2542266fb79'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:50 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:50 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "cinder-621137e5-62d1-43a3-8fd4-aa83607932f1-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-621137e5-62d1-43a3-8fd4-aa83607932f1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "cinder-quobyte-621137e5-62d1-43a3-8fd4-aa83607932f1" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-quobyte-621137e5-62d1-43a3-8fd4-aa83607932f1" acquired by "delete_volume" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e0ac75-713f-4514-9cc3-41e65a231a15]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-621137e5-62d1-43a3-8fd4-aa83607932f1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:50 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-621137e5-62d1-43a3-8fd4-aa83607932f1 Jul 03 13:56:50 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5dc49652-15d0-4d80-a441-da502244e41d tempest-VolumesExtendTest-913355309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5dc49652-15d0-4d80-a441-da502244e41d tempest-VolumesExtendTest-913355309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0482732-6fca-4a32-a59f-9f4867eb2648]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5dc49652-15d0-4d80-a441-da502244e41d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:50 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 Jul 03 13:56:50 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:51 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.038s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:51 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:51 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Deleted volume successfully. Jul 03 13:56:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c72e093f-5cb4-4d1f-a48e-e9d9330fb1a0 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-131be871-62e1-4c07-bf79-c29bebfc3288-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:51 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-621137e5-62d1-43a3-8fd4-aa83607932f1" returned: 0 in 1.166s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-621137e5-62d1-43a3-8fd4-aa83607932f1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:51 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-621137e5-62d1-43a3-8fd4-aa83607932f1 Jul 03 13:56:51 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:51 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5dc49652-15d0-4d80-a441-da502244e41d tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519" returned: 0 in 1.001s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5dc49652-15d0-4d80-a441-da502244e41d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f 2G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5dc49652-15d0-4d80-a441-da502244e41d tempest-VolumesExtendTest-913355309 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f 2G" returned: 0 in 0.210s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5dc49652-15d0-4d80-a441-da502244e41d tempest-VolumesExtendTest-913355309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.273s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:52 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-5dc49652-15d0-4d80-a441-da502244e41d tempest-VolumesExtendTest-913355309 None] Extend volume completed successfully. Jul 03 13:56:52 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-621137e5-62d1-43a3-8fd4-aa83607932f1" returned: 0 in 0.862s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-quobyte-621137e5-62d1-43a3-8fd4-aa83607932f1" released by "delete_volume" :: held 2.079s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:52 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Created reservations ['ae1a4583-f191-466d-b424-95bee84d5f01', 'fa1cd471-8958-4c80-8efe-2e9a23f8b43f', '1a3ac4d3-1a15-433c-bfc5-c312f933b4e4', '8a81e594-ee18-46b0-95f8-537f172532d7'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:52 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:52 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:52 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:52 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:53 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.712s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:53 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Deleted volume successfully. Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Acquiring lock "cinder-4a75aec1-efe8-4b48-9a4e-6075d325335f-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3136d1d1-2a3a-45fb-8633-75f1cec4d220 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-621137e5-62d1-43a3-8fd4-aa83607932f1-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Lock "cinder-4a75aec1-efe8-4b48-9a4e-6075d325335f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Acquiring lock "cinder-quobyte-e4fe1caf-42fc-4f89-b829-ecc1a414b519" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Lock "cinder-quobyte-e4fe1caf-42fc-4f89-b829-ecc1a414b519" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Acquiring lock "cinder-quobyte-4a75aec1-efe8-4b48-9a4e-6075d325335f" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Lock "cinder-quobyte-4a75aec1-efe8-4b48-9a4e-6075d325335f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Deleting offline snapshot 4a75aec1-efe8-4b48-9a4e-6075d325335f of volume e4fe1caf-42fc-4f89-b829-ecc1a414b519 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] snapshot_file for this snap is: volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c8ef80-46a8-485a-a7a7-cccef083daa4]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:53 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f Jul 03 13:56:53 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "cinder-b1ca2c81-343f-4ffb-85db-4daa856d4fe6-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-b1ca2c81-343f-4ffb-85db-4daa856d4fe6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "cinder-quobyte-b1ca2c81-343f-4ffb-85db-4daa856d4fe6" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-quobyte-b1ca2c81-343f-4ffb-85db-4daa856d4fe6" acquired by "delete_volume" :: waited 0.040s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[df03be33-8e3e-4627-b45c-818ecd0f6fb0]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:53 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6 Jul 03 13:56:53 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:54 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f" returned: 0 in 1.004s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:56:54 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea322111-6baf-4dfe-ad34-f25345dd1509]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:54 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 Jul 03 13:56:54 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:54 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6" returned: 0 in 0.943s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:54 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6 Jul 03 13:56:54 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:55 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519" returned: 0 in 1.147s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:55 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f Jul 03 13:56:55 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:55 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b1ca2c81-343f-4ffb-85db-4daa856d4fe6" returned: 0 in 0.976s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-quobyte-b1ca2c81-343f-4ffb-85db-4daa856d4fe6" released by "delete_volume" :: held 1.983s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:55 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Created reservations ['fa21d5cf-7591-46f0-aa6b-0594bfab07ac', 'bf82fb91-3089-4bed-a88b-ff242f34d91a', 'c0738217-3dac-49fc-891b-2233091980c9', '19cae54b-9bdd-4ee1-996d-d5351b15ca48'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:55 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:55 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "cinder-4a867445-93c3-414f-ae61-10347ad88661-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-4a867445-93c3-414f-ae61-10347ad88661-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "cinder-quobyte-4a867445-93c3-414f-ae61-10347ad88661" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-quobyte-4a867445-93c3-414f-ae61-10347ad88661" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:56 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[4372810a-44a3-4055-ab93-b16c5a72bb5e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a867445-93c3-414f-ae61-10347ad88661 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:56 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a867445-93c3-414f-ae61-10347ad88661 Jul 03 13:56:56 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:56 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.846s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:56 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:56 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Deleted volume successfully. Jul 03 13:56:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b11a3361-a349-4da3-a081-ea9323f92266 tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-b1ca2c81-343f-4ffb-85db-4daa856d4fe6-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:56 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f" returned: 0 in 1.221s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:56 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f Jul 03 13:56:56 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:57 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a867445-93c3-414f-ae61-10347ad88661" returned: 0 in 0.960s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a867445-93c3-414f-ae61-10347ad88661 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:57 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a867445-93c3-414f-ae61-10347ad88661 Jul 03 13:56:57 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:57 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519.4a75aec1-efe8-4b48-9a4e-6075d325335f" returned: 0 in 0.898s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Lock "cinder-quobyte-4a75aec1-efe8-4b48-9a4e-6075d325335f" released by "_delete_snapshot" :: held 4.388s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Lock "cinder-quobyte-e4fe1caf-42fc-4f89-b829-ecc1a414b519" released by "delete_snapshot" :: held 4.415s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:57 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Created reservations ['cdbc82e7-db9b-4c9b-98b6-384fa2815dfd', 'c21cacfc-d953-46d1-958f-55df7c296e8b', 'b895e3e4-58db-49c9-80e0-1ce67ab43099', '33268f8d-23ec-4b4e-8d0d-96a3b2c1f016'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:57 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Delete snapshot completed successfully. Jul 03 13:56:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5377091b-bf06-44f1-baec-4c3e8ce7b847 tempest-VolumesExtendTest-913355309 None] Lock "cinder-4a75aec1-efe8-4b48-9a4e-6075d325335f-delete_snapshot" released by "delete_snapshot" :: held 4.584s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:58 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a867445-93c3-414f-ae61-10347ad88661" returned: 0 in 0.799s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-quobyte-4a867445-93c3-414f-ae61-10347ad88661" released by "delete_volume" :: held 1.837s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Created reservations ['17d5d552-76a5-4adc-aba0-e5fa2150a8c8', '4ad85145-d55e-4a3c-ae5b-d0d4fda7dd7e', 'ed39d323-0c5e-4c74-9c9c-3b97746ea3b1', '77a57e5d-7205-4c60-8a82-ec87d861673c'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:58 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:56:58 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Acquiring lock "cinder-e4fe1caf-42fc-4f89-b829-ecc1a414b519-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Lock "cinder-e4fe1caf-42fc-4f89-b829-ecc1a414b519-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Acquiring lock "cinder-quobyte-e4fe1caf-42fc-4f89-b829-ecc1a414b519" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Lock "cinder-quobyte-e4fe1caf-42fc-4f89-b829-ecc1a414b519" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:56:58 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.774s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:56:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Deleted volume successfully. Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44fcb13-05bd-4772-8f28-a7e6ccf6f3bd]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eabf6d0f-8f3d-4fee-84b5-dbbe282d06fb tempest-CreateVolumesFromImageTest-267216533 None] Lock "cinder-4a867445-93c3-414f-ae61-10347ad88661-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:56:59 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 Jul 03 13:56:59 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:56:59 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Jul 03 13:56:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519" returned: 0 in 0.994s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:56:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:56:59 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519 Jul 03 13:56:59 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:00 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e4fe1caf-42fc-4f89-b829-ecc1a414b519" returned: 0 in 0.912s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Lock "cinder-quobyte-e4fe1caf-42fc-4f89-b829-ecc1a414b519" released by "delete_volume" :: held 2.003s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:00 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Created reservations ['e8bc2d62-b1eb-4607-97bf-7aec792742a4', 'c74e4744-b976-483f-a7d8-4043cf7996f3', 'f4d8af44-948c-4b16-85a1-5db060fbda47', '14a520a9-10b6-4e06-80dd-852ca523c505'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:01 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:57:01 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:01 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.954s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:01 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:01 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Deleted volume successfully. Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6974fcc2-eb74-4365-89b6-a8f83734670d tempest-VolumesExtendTest-913355309 None] Lock "cinder-e4fe1caf-42fc-4f89-b829-ecc1a414b519-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Flow 'volume_create_manager' (be28f820-5088-481c-9586-eca96832c599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0066282e-3366-46d9-bf7b-c8cb5495b463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0066282e-3366-46d9-bf7b-c8cb5495b463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-466652429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d99b586-e857-4d53-adbe-29f228bcad3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361b31e5945546979227dd3d92bff84b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:03Z,use_quota=True,user_id='edbf660d3f8f495d9d71c84e34d4c3c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75563eda-d3cf-461a-a132-f60539ef1d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75563eda-d3cf-461a-a132-f60539ef1d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d76de6f-2c2b-447f-8325-814c6b30d15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d76de6f-2c2b-447f-8325-814c6b30d15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d99b586-e857-4d53-adbe-29f228bcad3d', 'volume_name': 'volume-6d99b586-e857-4d53-adbe-29f228bcad3d', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fb1eed-a5a4-4589-8241-6a70fd13c6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fb1eed-a5a4-4589-8241-6a70fd13c6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1ae3fb-265e-4b86-8b8c-37d9c0d4acea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:02 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Volume 6d99b586-e857-4d53-adbe-29f228bcad3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d99b586-e857-4d53-adbe-29f228bcad3d', 'volume_size': 1} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-466652429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d99b586-e857-4d53-adbe-29f228bcad3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361b31e5945546979227dd3d92bff84b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:03Z,use_quota=True,user_id='edbf660d3f8f495d9d71c84e34d4c3c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Creating volume 6d99b586-e857-4d53-adbe-29f228bcad3d {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:57:02 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:57:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:02 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d 1073741824 Jul 03 13:57:02 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:03 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d 1073741824" returned: 0 in 0.984s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:03 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d Jul 03 13:57:03 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:04 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d" returned: 0 in 0.859s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:57:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1ae3fb-265e-4b86-8b8c-37d9c0d4acea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d99b586-e857-4d53-adbe-29f228bcad3d', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e63d90-2f99-4a21-b4cb-d3058739a1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:04 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Volume volume-6d99b586-e857-4d53-adbe-29f228bcad3d (6d99b586-e857-4d53-adbe-29f228bcad3d): created successfully Jul 03 13:57:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e63d90-2f99-4a21-b4cb-d3058739a1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Flow 'volume_create_manager' (be28f820-5088-481c-9586-eca96832c599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c5a2ffb1-5633-4f8f-ae57-1f5848d8de19 tempest-VolumeDependencyTests-789963902 None] Created volume successfully. Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] Creating offline snapshot 9777447d-d481-42bb-9cf9-30c3c74312a3 of volume 6d99b586-e857-4d53-adbe-29f228bcad3d {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf81ae25-7093-4bdd-8a55-7ed99807d5d6]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:06 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d Jul 03 13:57:06 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (06b08f8a-a589-44f4-8135-4726e64d849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dfe8692-9acb-4887-a4b8-c25fcb02de1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dfe8692-9acb-4887-a4b8-c25fcb02de1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1301856162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36bff19-0013-42d1-ab4c-b29058113cf2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:06Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a6dfa3-d59e-480d-b193-10e0583fb919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a6dfa3-d59e-480d-b193-10e0583fb919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2ef73f-8874-4127-8ef7-b300aa8af899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2ef73f-8874-4127-8ef7-b300aa8af899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b36bff19-0013-42d1-ab4c-b29058113cf2', 'volume_name': 'volume-b36bff19-0013-42d1-ab4c-b29058113cf2', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f170036b-b598-49c1-a343-5f6ce9e40bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f170036b-b598-49c1-a343-5f6ce9e40bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257e0776-cee5-4132-abcd-1661cbb658e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:06 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Volume b36bff19-0013-42d1-ab4c-b29058113cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b36bff19-0013-42d1-ab4c-b29058113cf2', 'volume_size': 1} Jul 03 13:57:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:07 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d" returned: 0 in 0.975s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:07 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 1G Jul 03 13:57:07 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:08 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 1G" returned: 0 in 1.023s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d99b586-e857-4d53-adbe-29f228bcad3d -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:08 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d99b586-e857-4d53-adbe-29f228bcad3d -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 Jul 03 13:57:08 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:08 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d99b586-e857-4d53-adbe-29f228bcad3d -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3" returned: 0 in 0.789s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:08 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 is being set with open permissions: ugo+rw Jul 03 13:57:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:08 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 Jul 03 13:57:08 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3" returned: 0 in 0.799s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:09 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:09 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.info Jul 03 13:57:09 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:10 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.info" returned: 0 in 1.045s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:10 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.info is being set with open permissions: ugo+rw Jul 03 13:57:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:10 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.info Jul 03 13:57:10 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:11 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.info" returned: 0 in 0.706s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.479s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.053s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1301856162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36bff19-0013-42d1-ab4c-b29058113cf2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:06Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:57:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Creating volume b36bff19-0013-42d1-ab4c-b29058113cf2 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:57:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:57:11 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:57:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b36bff19-0013-42d1-ab4c-b29058113cf2 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:11 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b36bff19-0013-42d1-ab4c-b29058113cf2 1073741824 Jul 03 13:57:11 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:11 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a9dd6b1c-3b1c-4498-ad91-4048b1b9bfdf tempest-VolumeDependencyTests-789963902 None] Create snapshot completed successfully Jul 03 13:57:12 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b36bff19-0013-42d1-ab4c-b29058113cf2 1073741824" returned: 0 in 0.898s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b36bff19-0013-42d1-ab4c-b29058113cf2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:12 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b36bff19-0013-42d1-ab4c-b29058113cf2 Jul 03 13:57:12 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:12 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Flow 'volume_create_manager' (a1b50783-224b-4132-885d-b7adfb4f8bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcb5b8c-0972-4b2c-8801-4897e368d476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcb5b8c-0972-4b2c-8801-4897e368d476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-211064607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22940970-efbf-4df9-a637-4eead80aaa00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361b31e5945546979227dd3d92bff84b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9777447d-d481-42bb-9cf9-30c3c74312a3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:13Z,use_quota=True,user_id='edbf660d3f8f495d9d71c84e34d4c3c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe7fe88-90c3-4939-b322-2c074830f668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe7fe88-90c3-4939-b322-2c074830f668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c80b57-8aef-471a-9504-ac5b8a7bfd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c80b57-8aef-471a-9504-ac5b8a7bfd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '22940970-efbf-4df9-a637-4eead80aaa00', 'volume_name': 'volume-22940970-efbf-4df9-a637-4eead80aaa00', 'volume_size': 1, 'snapshot_id': '9777447d-d481-42bb-9cf9-30c3c74312a3'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ef10d3-ef54-400b-b2cd-6d40eeea60f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ef10d3-ef54-400b-b2cd-6d40eeea60f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70370fc-9881-4948-9962-1f70c8a73b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:13 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Volume 22940970-efbf-4df9-a637-4eead80aaa00: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-22940970-efbf-4df9-a637-4eead80aaa00', 'volume_size': 1, 'snapshot_id': '9777447d-d481-42bb-9cf9-30c3c74312a3'} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:13 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b36bff19-0013-42d1-ab4c-b29058113cf2" returned: 0 in 0.686s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.044s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "cinder-quobyte-9777447d-d481-42bb-9cf9-30c3c74312a3-22940970-efbf-4df9-a637-4eead80aaa00" by "_create_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257e0776-cee5-4132-abcd-1661cbb658e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b36bff19-0013-42d1-ab4c-b29058113cf2', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7381f227-b1d0-4918-9b7f-90b64b5c6b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:13 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Volume volume-b36bff19-0013-42d1-ab4c-b29058113cf2 (b36bff19-0013-42d1-ab4c-b29058113cf2): created successfully Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7381f227-b1d0-4918-9b7f-90b64b5c6b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (06b08f8a-a589-44f4-8135-4726e64d849c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-quobyte-9777447d-d481-42bb-9cf9-30c3c74312a3-22940970-efbf-4df9-a637-4eead80aaa00" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Creating volume 22940970-efbf-4df9-a637-4eead80aaa00 from snapshot 9777447d-d481-42bb-9cf9-30c3c74312a3 {{(pid=86729) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "cinder-quobyte-22940970-efbf-4df9-a637-4eead80aaa00" by "_copy_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ff7bbb7b-9338-453b-bca2-ce4bec934595 tempest-VolumesGetTest-1846123539 None] Created volume successfully. Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-quobyte-22940970-efbf-4df9-a637-4eead80aaa00" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] snapshot: 9777447d-d481-42bb-9cf9-30c3c74312a3, volume: 22940970-efbf-4df9-a637-4eead80aaa00, {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb8bb74-e601-48fa-9a63-80208b5717aa]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:13 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 Jul 03 13:57:13 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:14 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3" returned: 0 in 0.808s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d99b586-e857-4d53-adbe-29f228bcad3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] will copy from snapshot at /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Creating direct copy from snapshot {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[047863f4-ec61-46bd-9a8c-04cc677b8c60]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:14 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d Jul 03 13:57:14 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (d3efe8ce-15df-4926-a877-f5212f194539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f77b645-fdc9-4499-8178-d874a03255b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f77b645-fdc9-4499-8178-d874a03255b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2107523606',display_name='tempest-VolumesGetTest-Volume-1027410837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d14934-600c-4236-8aaf-99ee339796b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:15Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f385ec34-454a-4bd5-81ca-b09b5607e24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f385ec34-454a-4bd5-81ca-b09b5607e24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6d1173-9c06-4fcc-b372-ba45de5780d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6d1173-9c06-4fcc-b372-ba45de5780d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d14934-600c-4236-8aaf-99ee339796b8', 'volume_name': 'volume-50d14934-600c-4236-8aaf-99ee339796b8', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3ef377-6be4-4875-b3ae-2229d002b235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3ef377-6be4-4875-b3ae-2229d002b235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790464f8-5a77-4f98-99ba-50460f40513c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:14 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Volume 50d14934-600c-4236-8aaf-99ee339796b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d14934-600c-4236-8aaf-99ee339796b8', 'volume_size': 1} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:14 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d" returned: 0 in 0.837s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG cinder.utils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Path /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00 not found in is_blk_device check {{(pid=86729) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:57:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:14 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00 Jul 03 13:57:14 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:23 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00" returned: 0 in 8.093s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81ddb92-0b34-477e-9351-425328845a37]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:23 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d Jul 03 13:57:23 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:24 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=90,cinder:SELECT=58,cinder:INSERT=21,cinder:DELETE=10 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:57:24 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:DELETE=6,cinder:SELECT=72,cinder:INSERT=23,cinder:UPDATE=89 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:57:24 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d" returned: 0 in 1.711s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:24 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d, size 1024.00 MB, duration 8.09 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:57:24 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Converted 1024.00 MB image at 126.51 MB/s Jul 03 13:57:24 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00 is being set with open permissions: ugo+rw Jul 03 13:57:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:24 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00 Jul 03 13:57:24 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:25 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00" returned: 0 in 0.957s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-quobyte-22940970-efbf-4df9-a637-4eead80aaa00" released by "_copy_volume_from_snapshot" :: held 12.517s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-quobyte-9777447d-d481-42bb-9cf9-30c3c74312a3-22940970-efbf-4df9-a637-4eead80aaa00" released by "_create_volume_from_snapshot" :: held 12.560s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.608s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.099s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2107523606',display_name='tempest-VolumesGetTest-Volume-1027410837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d14934-600c-4236-8aaf-99ee339796b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:15Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Creating volume 50d14934-600c-4236-8aaf-99ee339796b8 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:57:25 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50d14934-600c-4236-8aaf-99ee339796b8 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:25 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50d14934-600c-4236-8aaf-99ee339796b8 1073741824 Jul 03 13:57:25 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70370fc-9881-4948-9962-1f70c8a73b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22940970-efbf-4df9-a637-4eead80aaa00', 'volume_size': 1, 'snapshot_id': '9777447d-d481-42bb-9cf9-30c3c74312a3'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3386bc10-cec9-4d68-8b7b-30d7224369fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:25 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Volume volume-22940970-efbf-4df9-a637-4eead80aaa00 (22940970-efbf-4df9-a637-4eead80aaa00): created successfully Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3386bc10-cec9-4d68-8b7b-30d7224369fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Flow 'volume_create_manager' (a1b50783-224b-4132-885d-b7adfb4f8bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:26 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:57:26 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:26 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e3b624c4-45f8-4ec9-b648-9c5d726edc98 tempest-VolumeDependencyTests-789963902 None] Created volume successfully. Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "cinder-9777447d-d481-42bb-9cf9-30c3c74312a3-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-9777447d-d481-42bb-9cf9-30c3c74312a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "cinder-quobyte-6d99b586-e857-4d53-adbe-29f228bcad3d" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-quobyte-6d99b586-e857-4d53-adbe-29f228bcad3d" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "cinder-quobyte-9777447d-d481-42bb-9cf9-30c3c74312a3" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-quobyte-9777447d-d481-42bb-9cf9-30c3c74312a3" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Deleting offline snapshot 9777447d-d481-42bb-9cf9-30c3c74312a3 of volume 6d99b586-e857-4d53-adbe-29f228bcad3d {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] snapshot_file for this snap is: volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9f158f-b83a-4af0-8430-2a223688cb07]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:27 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.569s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:27 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 Jul 03 13:57:27 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:27 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50d14934-600c-4236-8aaf-99ee339796b8 1073741824" returned: 0 in 1.974s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50d14934-600c-4236-8aaf-99ee339796b8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:27 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50d14934-600c-4236-8aaf-99ee339796b8 Jul 03 13:57:27 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:28 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3" returned: 0 in 1.182s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d99b586-e857-4d53-adbe-29f228bcad3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:57:28 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c60a5c8-6ee2-4f31-ae45-2ac362208b9b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:28 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d Jul 03 13:57:28 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:28 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50d14934-600c-4236-8aaf-99ee339796b8" returned: 0 in 0.847s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] <== create_volume: return (2907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:57:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.910s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (790464f8-5a77-4f98-99ba-50460f40513c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d14934-600c-4236-8aaf-99ee339796b8', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dafe988-8d70-4936-b1e2-019b955aa744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:28 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Volume volume-50d14934-600c-4236-8aaf-99ee339796b8 (50d14934-600c-4236-8aaf-99ee339796b8): created successfully Jul 03 13:57:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dafe988-8d70-4936-b1e2-019b955aa744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (d3efe8ce-15df-4926-a877-f5212f194539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:28 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-98edcfb9-0088-473c-a627-21e862694a06 tempest-VolumesGetTest-1846123539 None] Created volume successfully. Jul 03 13:57:29 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d" returned: 0 in 0.810s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:29 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 Jul 03 13:57:29 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-50d14934-600c-4236-8aaf-99ee339796b8-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Lock "cinder-50d14934-600c-4236-8aaf-99ee339796b8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-quobyte-50d14934-600c-4236-8aaf-99ee339796b8" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-50d14934-600c-4236-8aaf-99ee339796b8" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:29 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f81fde-5abd-4f61-878e-b24e187875e1]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50d14934-600c-4236-8aaf-99ee339796b8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:30 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50d14934-600c-4236-8aaf-99ee339796b8 Jul 03 13:57:30 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:30 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3" returned: 0 in 0.787s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:30 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3 Jul 03 13:57:30 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:30 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50d14934-600c-4236-8aaf-99ee339796b8" returned: 0 in 0.803s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50d14934-600c-4236-8aaf-99ee339796b8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:30 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50d14934-600c-4236-8aaf-99ee339796b8 Jul 03 13:57:30 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:30 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d.9777447d-d481-42bb-9cf9-30c3c74312a3" returned: 0 in 0.709s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-quobyte-9777447d-d481-42bb-9cf9-30c3c74312a3" released by "_delete_snapshot" :: held 3.645s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-quobyte-6d99b586-e857-4d53-adbe-29f228bcad3d" released by "delete_snapshot" :: held 3.704s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:30 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Created reservations ['6fd6999f-23fe-4c79-b85f-34ab512e763f', 'f03955bb-e1e5-4913-b623-e392505f3d65', 'e9e66e1b-321f-4151-b0ee-682cb70f12e7', '1e523956-3210-46ce-b404-d8bd1ba350cb'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:31 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Delete snapshot completed successfully. Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8d3f73c3-c59a-4747-b9fb-a568b14f8cf8 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-9777447d-d481-42bb-9cf9-30c3c74312a3-delete_snapshot" released by "delete_snapshot" :: held 3.898s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Acquiring lock "cinder-6d99b586-e857-4d53-adbe-29f228bcad3d-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Lock "cinder-6d99b586-e857-4d53-adbe-29f228bcad3d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:31 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50d14934-600c-4236-8aaf-99ee339796b8" returned: 0 in 0.677s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Acquiring lock "cinder-quobyte-6d99b586-e857-4d53-adbe-29f228bcad3d" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-50d14934-600c-4236-8aaf-99ee339796b8" released by "delete_volume" :: held 1.543s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Lock "cinder-quobyte-6d99b586-e857-4d53-adbe-29f228bcad3d" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53a154f-fec1-4430-b62d-d90315cd84d5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Created reservations ['290ae1ac-4b69-4491-882a-4281635e08d5', '3768c588-42fb-4a52-be00-28bba32c8e22', '4c90e85c-1904-4f68-b226-94e0d81c179c', '47352029-e6b9-4529-8460-f9a972f9a2a9'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:31 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d Jul 03 13:57:31 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:31 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:57:31 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-b36bff19-0013-42d1-ab4c-b29058113cf2-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Lock "cinder-b36bff19-0013-42d1-ab4c-b29058113cf2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-quobyte-b36bff19-0013-42d1-ab4c-b29058113cf2" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-b36bff19-0013-42d1-ab4c-b29058113cf2" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f00c4-6902-4e69-8b42-bdf738467729]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b36bff19-0013-42d1-ab4c-b29058113cf2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:32 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.712s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:32 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:32 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Deleted volume successfully. Jul 03 13:57:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b0c8a3b9-5670-4c0b-8b10-760cd74b3b36 tempest-VolumesGetTest-1846123539 None] Lock "cinder-50d14934-600c-4236-8aaf-99ee339796b8-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:32 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b36bff19-0013-42d1-ab4c-b29058113cf2 Jul 03 13:57:32 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:32 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d" returned: 0 in 0.872s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:32 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d Jul 03 13:57:32 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:33 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d99b586-e857-4d53-adbe-29f228bcad3d" returned: 0 in 0.793s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:33 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b36bff19-0013-42d1-ab4c-b29058113cf2" returned: 0 in 0.945s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b36bff19-0013-42d1-ab4c-b29058113cf2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Lock "cinder-quobyte-6d99b586-e857-4d53-adbe-29f228bcad3d" released by "delete_volume" :: held 1.741s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:33 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b36bff19-0013-42d1-ab4c-b29058113cf2 Jul 03 13:57:33 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Created reservations ['a6005463-4fae-4590-8d18-de4d12940f69', 'f4d69d36-61ca-4cd2-b2ea-db5fb48b7bea', '55d943cb-e71b-45a8-b10b-9c5823f33804', '5d58b898-d04f-44ce-bd6e-7e9ac5825d5c'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:33 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:57:33 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "cinder-22940970-efbf-4df9-a637-4eead80aaa00-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-22940970-efbf-4df9-a637-4eead80aaa00-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "cinder-quobyte-22940970-efbf-4df9-a637-4eead80aaa00" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-quobyte-22940970-efbf-4df9-a637-4eead80aaa00" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dc0880-9af6-4f35-b843-776a00479378]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:34 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00 Jul 03 13:57:34 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:34 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b36bff19-0013-42d1-ab4c-b29058113cf2" returned: 0 in 1.034s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-b36bff19-0013-42d1-ab4c-b29058113cf2" released by "delete_volume" :: held 2.048s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:34 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.021s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Created reservations ['7b90c54a-6c1f-4d49-a507-ae5514823e6d', 'f0d7c34d-fc9a-4b82-ac0e-a7e4ec339517', '80647a44-cc65-4f3e-b75e-57a867599be4', '24582989-aca5-46b4-b92b-c2835e4f1714'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Deleted volume successfully. Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e1d6cc64-2212-4228-ad38-a680fbcbdb5c tempest-VolumeDependencyTests-789963902 None] Lock "cinder-6d99b586-e857-4d53-adbe-29f228bcad3d-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:34 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:57:34 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:34 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00" returned: 0 in 1.088s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:35 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00 Jul 03 13:57:35 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:35 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.772s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:35 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:35 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Deleted volume successfully. Jul 03 13:57:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6ede0ea5-a3f7-42c9-870d-31181462609b tempest-VolumesGetTest-1846123539 None] Lock "cinder-b36bff19-0013-42d1-ab4c-b29058113cf2-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:35 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-22940970-efbf-4df9-a637-4eead80aaa00" returned: 0 in 0.943s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-quobyte-22940970-efbf-4df9-a637-4eead80aaa00" released by "delete_volume" :: held 2.086s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Created reservations ['299e0d4c-cc81-4fac-a488-e4546cb5cda7', '040d8441-18ea-4ce0-bc9b-60113401e9be', '70323c76-218a-4cc0-98eb-1478a34c5d88', '144324d5-890c-432d-8f4b-732984eebdce'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:36 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:57:36 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (a0037f11-122e-4c9c-9239-786b6c29cce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1ae5e7-1f0d-4ba8-90d5-a25e619a408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1ae5e7-1f0d-4ba8-90d5-a25e619a408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1361519333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5a3301-c868-4820-908c-f3588e03e77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:36Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033f6830-00be-4911-a169-464ec68c63f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033f6830-00be-4911-a169-464ec68c63f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9230897d-2018-483d-bd43-c84389304103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9230897d-2018-483d-bd43-c84389304103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd5a3301-c868-4820-908c-f3588e03e77e', 'volume_name': 'volume-cd5a3301-c868-4820-908c-f3588e03e77e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944b99fa-7320-40f1-89ed-7fdf2866f882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944b99fa-7320-40f1-89ed-7fdf2866f882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd68aa5-d8a6-439b-afe4-e34badd7705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:36 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Volume cd5a3301-c868-4820-908c-f3588e03e77e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd5a3301-c868-4820-908c-f3588e03e77e', 'volume_size': 1} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1361519333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5a3301-c868-4820-908c-f3588e03e77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:36Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Creating volume cd5a3301-c868-4820-908c-f3588e03e77e {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:57:36 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:36 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e 1073741824 Jul 03 13:57:36 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:36 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.787s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:36 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:57:36 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Deleted volume successfully. Jul 03 13:57:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-31f47d85-0398-4985-858a-52684fec8e92 tempest-VolumeDependencyTests-789963902 None] Lock "cinder-22940970-efbf-4df9-a637-4eead80aaa00-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:37 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e 1073741824" returned: 0 in 0.994s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:37 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e Jul 03 13:57:37 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:38 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e" returned: 0 in 0.843s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:57:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd68aa5-d8a6-439b-afe4-e34badd7705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd5a3301-c868-4820-908c-f3588e03e77e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc498ce-619b-4aca-a20d-e7293cb46b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:38 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Volume volume-cd5a3301-c868-4820-908c-f3588e03e77e (cd5a3301-c868-4820-908c-f3588e03e77e): created successfully Jul 03 13:57:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc498ce-619b-4aca-a20d-e7293cb46b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (a0037f11-122e-4c9c-9239-786b6c29cce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c72c9760-2ba1-4619-ae10-e2f14734ae3c tempest-VolumesGetTest-1846123539 None] Created volume successfully. Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (5f03df64-7e27-4e66-9349-ab8ef2e5d8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a81ef2-614a-4af7-b4c7-6721d13009f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a81ef2-614a-4af7-b4c7-6721d13009f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-880483880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd33374-58c6-4364-82b7-72194927b327,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cd5a3301-c868-4820-908c-f3588e03e77e,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:40Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0dfc52-b481-42d3-852d-a681fc5855b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0dfc52-b481-42d3-852d-a681fc5855b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b99585b-084d-4216-8b42-3b8c291f0a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b99585b-084d-4216-8b42-3b8c291f0a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0cd33374-58c6-4364-82b7-72194927b327', 'volume_name': 'volume-0cd33374-58c6-4364-82b7-72194927b327', 'volume_size': 1, 'source_volid': 'cd5a3301-c868-4820-908c-f3588e03e77e', 'source_volstatus': 'available'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbffa21-fb41-471e-b006-a5dbe1c8409e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbffa21-fb41-471e-b006-a5dbe1c8409e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ca3f8f-228e-4eff-8f6b-d6f1a7f26874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:40 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Volume 0cd33374-58c6-4364-82b7-72194927b327: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0cd33374-58c6-4364-82b7-72194927b327', 'volume_size': 1, 'source_volid': 'cd5a3301-c868-4820-908c-f3588e03e77e', 'source_volstatus': 'available'} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:40 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Cloning volume cd5a3301-c868-4820-908c-f3588e03e77e to volume 0cd33374-58c6-4364-82b7-72194927b327 Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Creating offline snapshot c4bc5356-073b-461e-b8b7-82956858971e of volume cd5a3301-c868-4820-908c-f3588e03e77e {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[661c45c2-cb67-400b-90f7-7c4418233f2b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:40 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e Jul 03 13:57:40 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:41 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e" returned: 0 in 1.170s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:41 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e 1G Jul 03 13:57:41 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:42 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e 1G" returned: 0 in 1.135s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5a3301-c868-4820-908c-f3588e03e77e -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:42 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5a3301-c868-4820-908c-f3588e03e77e -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e Jul 03 13:57:42 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:43 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5a3301-c868-4820-908c-f3588e03e77e -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e" returned: 0 in 0.860s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:43 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e is being set with open permissions: ugo+rw Jul 03 13:57:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:43 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e Jul 03 13:57:43 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:44 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e" returned: 0 in 0.977s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:44 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.info Jul 03 13:57:44 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Flow 'volume_create_manager' (4d4408c3-7c8f-4cbc-9b8e-d41a83fd6492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f4efb4-80f1-4c6b-9a79-8a3e805e71e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f4efb4-80f1-4c6b-9a79-8a3e805e71e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1600787980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49483f64-03fd-4400-b7b7-41db69135a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58eaba28865940ea8135c0ae90c80b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:45Z,use_quota=True,user_id='72d2945659ed434da3612b7c51afdb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfa78aa-9870-4fc8-81c9-5fd06db4d208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfa78aa-9870-4fc8-81c9-5fd06db4d208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2df522c-28ad-4cc6-bf94-336ed2c46618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2df522c-28ad-4cc6-bf94-336ed2c46618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49483f64-03fd-4400-b7b7-41db69135a2a', 'volume_name': 'volume-49483f64-03fd-4400-b7b7-41db69135a2a', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a627fa-95ff-442b-99b0-47389f45d34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a627fa-95ff-442b-99b0-47389f45d34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87ab6c4-66c5-428e-b98f-0bfca2b80aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:45 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Volume 49483f64-03fd-4400-b7b7-41db69135a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49483f64-03fd-4400-b7b7-41db69135a2a', 'volume_size': 1} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:45 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.info" returned: 0 in 0.927s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:45 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.info is being set with open permissions: ugo+rw Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:45 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.info Jul 03 13:57:45 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Flow 'volume_create_manager' (2a060788-4e81-46bc-80ba-0a9b91d88eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2321707-71ba-4940-b18e-d88fb0cf84a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2321707-71ba-4940-b18e-d88fb0cf84a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-918437388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4832edcf-a009-439e-9fc9-d7294f1a0e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5863c3c0fa44dd9e3a6332b24ca878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:45Z,use_quota=True,user_id='f9071a0f659b409897d736fdd4cc26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb236fac-3cee-489c-9c2d-4a945197b60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb236fac-3cee-489c-9c2d-4a945197b60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f4f617-36f7-4774-99a6-f648aa9484f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f4f617-36f7-4774-99a6-f648aa9484f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4832edcf-a009-439e-9fc9-d7294f1a0e63', 'volume_name': 'volume-4832edcf-a009-439e-9fc9-d7294f1a0e63', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b35824-3e45-459d-ac7e-cfa06d3ab21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b35824-3e45-459d-ac7e-cfa06d3ab21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0033858e-5e74-47a7-9128-a544ac0fe02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:45 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Volume 4832edcf-a009-439e-9fc9-d7294f1a0e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4832edcf-a009-439e-9fc9-d7294f1a0e63', 'volume_size': 1} Jul 03 13:57:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:46 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.info" returned: 0 in 0.826s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-quobyte-0cd33374-58c6-4364-82b7-72194927b327" by "_copy_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-0cd33374-58c6-4364-82b7-72194927b327" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] snapshot: c4bc5356-073b-461e-b8b7-82956858971e, volume: 0cd33374-58c6-4364-82b7-72194927b327, {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:57:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:46 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[522b46bb-f820-4f9d-8432-cbc0c264f0ee]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:46 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e Jul 03 13:57:46 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:47 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e" returned: 0 in 0.794s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd5a3301-c868-4820-908c-f3588e03e77e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:57:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] will copy from snapshot at /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:57:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Creating direct copy from snapshot {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:57:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3823e68d-dd26-4fda-bd95-dae2f52d436f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:47 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e Jul 03 13:57:47 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:47 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e" returned: 0 in 0.770s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:47 devstack cinder-volume[86729]: DEBUG cinder.utils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Path /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327 not found in is_blk_device check {{(pid=86729) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:57:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:47 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327 Jul 03 13:57:47 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:53 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327" returned: 0 in 5.867s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:53 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a745083-0e48-4611-bc01-926890b7801c]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:53 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e Jul 03 13:57:53 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:54 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e" returned: 0 in 0.987s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:54 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:57:54 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Converted 1024.00 MB image at 174.51 MB/s Jul 03 13:57:54 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327 is being set with open permissions: ugo+rw Jul 03 13:57:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:54 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327 Jul 03 13:57:54 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:55 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327" returned: 0 in 0.671s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-0cd33374-58c6-4364-82b7-72194927b327" released by "_copy_volume_from_snapshot" :: held 9.177s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-quobyte-c4bc5356-073b-461e-b8b7-82956858971e" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:57:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-c4bc5356-073b-461e-b8b7-82956858971e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:57:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Deleting offline snapshot c4bc5356-073b-461e-b8b7-82956858971e of volume cd5a3301-c868-4820-908c-f3588e03e77e {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:57:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] snapshot_file for this snap is: volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:57:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cfd794-0910-4c82-890a-f719b41bcd94]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:55 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e Jul 03 13:57:55 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:55 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=49,cinder:SELECT=38,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:57:56 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e" returned: 0 in 0.757s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd5a3301-c868-4820-908c-f3588e03e77e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:57:56 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7073a3-8e67-4994-a00c-b25bb8f614a3]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:57:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:56 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e Jul 03 13:57:56 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:56 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e" returned: 0 in 0.719s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:56 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e Jul 03 13:57:56 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:57 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e" returned: 0 in 0.746s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:57 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e Jul 03 13:57:57 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:58 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e.c4bc5356-073b-461e-b8b7-82956858971e" returned: 0 in 0.645s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-c4bc5356-073b-461e-b8b7-82956858971e" released by "_delete_snapshot" :: held 2.966s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.270s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.106s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1600787980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49483f64-03fd-4400-b7b7-41db69135a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58eaba28865940ea8135c0ae90c80b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:45Z,use_quota=True,user_id='72d2945659ed434da3612b7c51afdb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Creating volume 49483f64-03fd-4400-b7b7-41db69135a2a {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:57:58 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ca3f8f-228e-4eff-8f6b-d6f1a7f26874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd33374-58c6-4364-82b7-72194927b327', 'volume_size': 1, 'source_volid': 'cd5a3301-c868-4820-908c-f3588e03e77e', 'source_volstatus': 'available'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:58 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a 1073741824 Jul 03 13:57:58 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9450d10f-1586-4fd2-9f05-74e89123fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:58 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Volume volume-0cd33374-58c6-4364-82b7-72194927b327 (0cd33374-58c6-4364-82b7-72194927b327): created successfully Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9450d10f-1586-4fd2-9f05-74e89123fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (5f03df64-7e27-4e66-9349-ab8ef2e5d8ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9f35b32b-94c7-4f21-9f60-22e6b5df9212 tempest-VolumesGetTest-1846123539 None] Created volume successfully. Jul 03 13:57:59 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a 1073741824" returned: 0 in 0.869s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:57:59 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a Jul 03 13:57:59 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (b83af958-d744-446f-a0dc-c55432d4745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0ed93a-48ec-4e0e-a5d6-d391993325e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0ed93a-48ec-4e0e-a5d6-d391993325e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1442179540',display_name='tempest-VolumesGetTest-Volume-1042653970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee18e74f-b508-4ba9-a16d-eddd5ddf5296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:00Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc487e3-4a10-4a6a-9b8f-2a8fe678d349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc487e3-4a10-4a6a-9b8f-2a8fe678d349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b41bad-8900-4ef8-89d8-1bef7bb73e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b41bad-8900-4ef8-89d8-1bef7bb73e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee18e74f-b508-4ba9-a16d-eddd5ddf5296', 'volume_name': 'volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1e26b6-623f-4a46-b5d0-947701d4fe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1e26b6-623f-4a46-b5d0-947701d4fe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48396a8e-12aa-4297-a5d7-17cb4cd7282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:57:59 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Volume ee18e74f-b508-4ba9-a16d-eddd5ddf5296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296', 'volume_size': 1} Jul 03 13:57:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:00 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a" returned: 0 in 0.698s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.357s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-918437388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4832edcf-a009-439e-9fc9-d7294f1a0e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5863c3c0fa44dd9e3a6332b24ca878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:57:45Z,use_quota=True,user_id='f9071a0f659b409897d736fdd4cc26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Creating volume 4832edcf-a009-439e-9fc9-d7294f1a0e63 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:00 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4832edcf-a009-439e-9fc9-d7294f1a0e63 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:00 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4832edcf-a009-439e-9fc9-d7294f1a0e63 1073741824 Jul 03 13:58:00 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87ab6c4-66c5-428e-b98f-0bfca2b80aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49483f64-03fd-4400-b7b7-41db69135a2a', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3020a04-0aec-4b8c-8311-67c4dc476e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:00 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Volume volume-49483f64-03fd-4400-b7b7-41db69135a2a (49483f64-03fd-4400-b7b7-41db69135a2a): created successfully Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3020a04-0aec-4b8c-8311-67c4dc476e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Flow 'volume_create_manager' (4d4408c3-7c8f-4cbc-9b8e-d41a83fd6492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:00 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9a21b37c-9c42-42ec-a758-f7cce76f7444 tempest-AttachVolumeNegativeTest-1456526646 None] Created volume successfully. Jul 03 13:58:00 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4832edcf-a009-439e-9fc9-d7294f1a0e63 1073741824" returned: 0 in 0.832s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4832edcf-a009-439e-9fc9-d7294f1a0e63 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:00 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4832edcf-a009-439e-9fc9-d7294f1a0e63 Jul 03 13:58:00 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:01 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4832edcf-a009-439e-9fc9-d7294f1a0e63" returned: 0 in 0.757s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.926s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:57:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1442179540',display_name='tempest-VolumesGetTest-Volume-1042653970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee18e74f-b508-4ba9-a16d-eddd5ddf5296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:00Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Creating volume ee18e74f-b508-4ba9-a16d-eddd5ddf5296 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:01 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0033858e-5e74-47a7-9128-a544ac0fe02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4832edcf-a009-439e-9fc9-d7294f1a0e63', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ddbea0-215d-40e2-b3e4-53bdcb7ac822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:01 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296 1073741824 Jul 03 13:58:01 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:01 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Volume volume-4832edcf-a009-439e-9fc9-d7294f1a0e63 (4832edcf-a009-439e-9fc9-d7294f1a0e63): created successfully Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ddbea0-215d-40e2-b3e4-53bdcb7ac822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Flow 'volume_create_manager' (2a060788-4e81-46bc-80ba-0a9b91d88eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:01 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a98561e3-0ef4-4567-b560-d8a675c05b07 tempest-VolumesActionsTest-1162189829 None] Created volume successfully. Jul 03 13:58:02 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296 1073741824" returned: 0 in 0.956s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:02 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296 Jul 03 13:58:02 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ab9224b2-6196-4891-8d57-de2af4dbc011 tempest-VolumesActionsTest-1162189829 None] Acquiring lock "cinder-4832edcf-a009-439e-9fc9-d7294f1a0e63" by "attach_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ab9224b2-6196-4891-8d57-de2af4dbc011 tempest-VolumesActionsTest-1162189829 None] Lock "cinder-4832edcf-a009-439e-9fc9-d7294f1a0e63" acquired by "attach_volume" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:02 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ab9224b2-6196-4891-8d57-de2af4dbc011 tempest-VolumesActionsTest-1162189829 None] Attaching volume 4832edcf-a009-439e-9fc9-d7294f1a0e63 to instance e2cca387-3eb3-4321-a846-8b66c4a0d8c7 at mountpoint /dev/vdb on host None. Jul 03 13:58:02 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ab9224b2-6196-4891-8d57-de2af4dbc011 tempest-VolumesActionsTest-1162189829 None] Attach volume completed successfully. Jul 03 13:58:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ab9224b2-6196-4891-8d57-de2af4dbc011 tempest-VolumesActionsTest-1162189829 None] Lock "cinder-4832edcf-a009-439e-9fc9-d7294f1a0e63" released by "attach_volume" :: held 0.088s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:03 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296" returned: 0 in 0.696s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48396a8e-12aa-4297-a5d7-17cb4cd7282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7034e23f-8cc9-41d2-bbb7-450d3b902515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:03 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Volume volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296 (ee18e74f-b508-4ba9-a16d-eddd5ddf5296): created successfully Jul 03 13:58:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7034e23f-8cc9-41d2-bbb7-450d3b902515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (b83af958-d744-446f-a0dc-c55432d4745d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:03 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b908439b-9aed-486d-a4d5-5fba2f3d4ed5 tempest-VolumesGetTest-1846123539 None] Created volume successfully. Jul 03 13:58:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-ee18e74f-b508-4ba9-a16d-eddd5ddf5296-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-00146646-e487-4ce1-a818-5a6ec1dd5e41 tempest-VolumesActionsTest-249330852 None] Terminate volume connection completed successfully. Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Lock "cinder-ee18e74f-b508-4ba9-a16d-eddd5ddf5296-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-quobyte-ee18e74f-b508-4ba9-a16d-eddd5ddf5296" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-ee18e74f-b508-4ba9-a16d-eddd5ddf5296" acquired by "delete_volume" :: waited 0.013s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee3a9c3-2681-40ab-8854-10362c553262]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:04 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296 Jul 03 13:58:04 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-c51f64c0-3153-4489-8c26-9e6e24b56941 req-ec82d959-26d6-4e7b-b8f2-88100dbe62e9 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-c51f64c0-3153-4489-8c26-9e6e24b56941 req-ec82d959-26d6-4e7b-b8f2-88100dbe62e9 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[878bbf8c-df9a-4900-96ef-ee619a052d10]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-c51f64c0-3153-4489-8c26-9e6e24b56941 req-ec82d959-26d6-4e7b-b8f2-88100dbe62e9 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:04 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a Jul 03 13:58:04 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00146646-e487-4ce1-a818-5a6ec1dd5e41 tempest-VolumesActionsTest-249330852 None] Acquiring lock "cinder-4832edcf-a009-439e-9fc9-d7294f1a0e63-detach_volume" by "detach_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00146646-e487-4ce1-a818-5a6ec1dd5e41 tempest-VolumesActionsTest-249330852 None] Lock "cinder-4832edcf-a009-439e-9fc9-d7294f1a0e63-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-00146646-e487-4ce1-a818-5a6ec1dd5e41 tempest-VolumesActionsTest-249330852 None] Detaching volume 4832edcf-a009-439e-9fc9-d7294f1a0e63 from instance e2cca387-3eb3-4321-a846-8b66c4a0d8c7. Jul 03 13:58:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-00146646-e487-4ce1-a818-5a6ec1dd5e41 tempest-VolumesActionsTest-249330852 None] Detach volume completed successfully. Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00146646-e487-4ce1-a818-5a6ec1dd5e41 tempest-VolumesActionsTest-249330852 None] Lock "cinder-4832edcf-a009-439e-9fc9-d7294f1a0e63-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:04 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296" returned: 0 in 0.774s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:04 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296 Jul 03 13:58:04 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:05 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-c51f64c0-3153-4489-8c26-9e6e24b56941 req-ec82d959-26d6-4e7b-b8f2-88100dbe62e9 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a" returned: 0 in 0.834s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-c51f64c0-3153-4489-8c26-9e6e24b56941 req-ec82d959-26d6-4e7b-b8f2-88100dbe62e9 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.858s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-c51f64c0-3153-4489-8c26-9e6e24b56941 req-ec82d959-26d6-4e7b-b8f2-88100dbe62e9 tempest-AttachVolumeNegativeTest-1456526646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-49483f64-03fd-4400-b7b7-41db69135a2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d20e299-e92a-44e0-8c9f-ade6578db3d0', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8ff41dac-3910-4df0-8606-08bed8497d4c tempest-VolumesActionsTest-1162189829 None] Acquiring lock "cinder-4832edcf-a009-439e-9fc9-d7294f1a0e63-detach_volume" by "detach_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8ff41dac-3910-4df0-8606-08bed8497d4c tempest-VolumesActionsTest-1162189829 None] Lock "cinder-4832edcf-a009-439e-9fc9-d7294f1a0e63-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-8ff41dac-3910-4df0-8606-08bed8497d4c tempest-VolumesActionsTest-1162189829 None] Volume detach called, but volume not attached. Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8ff41dac-3910-4df0-8606-08bed8497d4c tempest-VolumesActionsTest-1162189829 None] Lock "cinder-4832edcf-a009-439e-9fc9-d7294f1a0e63-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-c51f64c0-3153-4489-8c26-9e6e24b56941 req-ec82d959-26d6-4e7b-b8f2-88100dbe62e9 tempest-AttachVolumeNegativeTest-1456526646 None] attachment_update completed successfully. Jul 03 13:58:05 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ee18e74f-b508-4ba9-a16d-eddd5ddf5296" returned: 0 in 0.644s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-ee18e74f-b508-4ba9-a16d-eddd5ddf5296" released by "delete_volume" :: held 1.460s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Created reservations ['d2c00f78-31aa-4166-ac58-0d36258b3a05', 'dd811251-a2ab-49a8-85d8-5c92fd99ccd2', 'e732f8d9-bb0f-45f7-9726-61b8258bca8f', '0cf05328-5a9b-4788-9749-10082ebb154d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:05 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:58:05 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Acquiring lock "cinder-4832edcf-a009-439e-9fc9-d7294f1a0e63-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Lock "cinder-4832edcf-a009-439e-9fc9-d7294f1a0e63-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Acquiring lock "cinder-quobyte-4832edcf-a009-439e-9fc9-d7294f1a0e63" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Lock "cinder-quobyte-4832edcf-a009-439e-9fc9-d7294f1a0e63" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efaa3f1-465e-4f4f-8a82-7cd51ddd058d]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4832edcf-a009-439e-9fc9-d7294f1a0e63 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:06 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4832edcf-a009-439e-9fc9-d7294f1a0e63 Jul 03 13:58:06 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-0cd33374-58c6-4364-82b7-72194927b327-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Lock "cinder-0cd33374-58c6-4364-82b7-72194927b327-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-quobyte-0cd33374-58c6-4364-82b7-72194927b327" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-0cd33374-58c6-4364-82b7-72194927b327" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec387bc2-e6f9-4082-8a60-58ac505b207a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:06 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.930s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:06 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Deleted volume successfully. Jul 03 13:58:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6fc5c1ef-b08b-463f-9a45-225e6ec90698 tempest-VolumesGetTest-1846123539 None] Lock "cinder-ee18e74f-b508-4ba9-a16d-eddd5ddf5296-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:06 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327 Jul 03 13:58:06 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:07 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4832edcf-a009-439e-9fc9-d7294f1a0e63" returned: 0 in 1.010s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4832edcf-a009-439e-9fc9-d7294f1a0e63 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:07 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4832edcf-a009-439e-9fc9-d7294f1a0e63 Jul 03 13:58:07 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:07 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327" returned: 0 in 1.050s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:07 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327 Jul 03 13:58:07 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:07 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4832edcf-a009-439e-9fc9-d7294f1a0e63" returned: 0 in 0.745s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Lock "cinder-quobyte-4832edcf-a009-439e-9fc9-d7294f1a0e63" released by "delete_volume" :: held 1.813s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Created reservations ['edb9fe52-d170-4e0d-b005-05aa6d6528f7', 'b6e564e8-56a4-4242-88ea-5fbf5bf63816', '74a7be8a-5a7c-43cc-974b-e9ed0dcd6317', '80d7c2be-ed4c-4c9a-9666-e5f2a165d583'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:08 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:58:08 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:08 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0cd33374-58c6-4364-82b7-72194927b327" returned: 0 in 0.765s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-0cd33374-58c6-4364-82b7-72194927b327" released by "delete_volume" :: held 1.894s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Created reservations ['6a980f42-b6eb-465b-8131-ee06271628ff', 'a0260adf-795f-47a8-8408-61c1afa54079', 'c2362b43-baec-421d-95e2-d46da0ddb12a', '2b1268c6-697a-41f8-944b-0fa1623ecb98'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:08 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:58:08 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:08 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-cd5a3301-c868-4820-908c-f3588e03e77e-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.812s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:08 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Deleted volume successfully. Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Lock "cinder-cd5a3301-c868-4820-908c-f3588e03e77e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-995dd2a0-1948-4350-bcdf-add1f615a44a tempest-VolumesActionsTest-1162189829 None] Lock "cinder-4832edcf-a009-439e-9fc9-d7294f1a0e63-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-quobyte-cd5a3301-c868-4820-908c-f3588e03e77e" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-cd5a3301-c868-4820-908c-f3588e03e77e" acquired by "delete_volume" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c524ad0-a5c2-4364-bf93-7b7e2fe5ed3a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:09 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e Jul 03 13:58:09 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:09 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.727s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:09 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:09 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Deleted volume successfully. Jul 03 13:58:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9c719692-c598-4ca7-9173-28348c0aece7 tempest-VolumesGetTest-1846123539 None] Lock "cinder-0cd33374-58c6-4364-82b7-72194927b327-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:09 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e" returned: 0 in 1.013s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:09 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e Jul 03 13:58:10 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:10 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cd5a3301-c868-4820-908c-f3588e03e77e" returned: 0 in 0.667s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-cd5a3301-c868-4820-908c-f3588e03e77e" released by "delete_volume" :: held 1.753s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:10 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Created reservations ['f2e6dc56-1e82-4e66-ae75-6a55f9b6e174', '38d4ade4-7afe-4757-ad28-b5607ed63c14', '68ac72d9-fd5e-4530-bf44-f0c08d073032', '4a030ded-0455-4d65-9e7d-fcf01a45ea8c'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:10 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:58:10 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:11 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.982s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:11 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:11 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Deleted volume successfully. Jul 03 13:58:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c94e1c9c-ab80-4fd8-8116-54aeda87a7bd tempest-VolumesGetTest-1846123539 None] Lock "cinder-cd5a3301-c868-4820-908c-f3588e03e77e-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (195cddc5-727d-4f4b-8ab4-ea41368a4a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b667ea89-d9de-491a-a4ee-28c843782119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b667ea89-d9de-491a-a4ee-28c843782119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-133988912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2062f498-86c0-4ec6-b150-9d5fe0cd6bae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:12Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53586883-cb30-4022-9698-c00357083da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53586883-cb30-4022-9698-c00357083da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6d25c2-813c-45ed-9e0f-1d6d72192cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.image.glance [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Creating Keystone auth plugin from conf {{(pid=86729) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6d25c2-813c-45ed-9e0f-1d6d72192cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2062f498-86c0-4ec6-b150-9d5fe0cd6bae', 'volume_name': 'volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae', 'volume_size': 1, 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24c8a015e6c74647b59cf3465f3aee9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'created_at': datetime.datetime(2026, 7, 3, 11, 40, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 40, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da3b4b5-eb86-4c06-92bf-2493eb1aea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da3b4b5-eb86-4c06-92bf-2493eb1aea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730211ad-b187-4e21-8f5d-2e6d2d3a38cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:12 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Volume 2062f498-86c0-4ec6-b150-9d5fe0cd6bae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae', 'volume_size': 1, 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24c8a015e6c74647b59cf3465f3aee9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'created_at': datetime.datetime(2026, 7, 3, 11, 40, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 40, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Trying to clone 2062f498-86c0-4ec6-b150-9d5fe0cd6bae from image c72364f8-58c5-4ca3-8348-fe92aceb54bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]). {{(pid=86729) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 13:58:12 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Image download 20.69 MB at 20.69 MB/s Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7caf5f6-ec1d-4a1c-b5c6-cd468a7b4cff]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:13 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD Jul 03 13:58:13 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:13 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:13 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Temporary image c72364f8-58c5-4ca3-8348-fe92aceb54bd is fetched for user 626fe104ca474432a5a79f9105ced61f. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 13:58:13 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdfdaa3-c477-4f24-90a3-c4778318f83f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:13 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD Jul 03 13:58:13 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:14 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-133988912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2062f498-86c0-4ec6-b150-9d5fe0cd6bae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:12Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Creating volume 2062f498-86c0-4ec6-b150-9d5fe0cd6bae {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:14 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:58:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:14 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae 1073741824 Jul 03 13:58:14 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Flow 'volume_create_manager' (1cf241ab-68a1-4bce-80b7-29d2aa14de79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba36136-e651-415b-abc5-c29923e3717b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:15 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba36136-e651-415b-abc5-c29923e3717b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-734615725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420fd726-84d5-4266-8860-9065cd908ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5863c3c0fa44dd9e3a6332b24ca878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:15Z,use_quota=True,user_id='f9071a0f659b409897d736fdd4cc26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb314b4-1c35-40b6-ba11-4b17cbd027ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb314b4-1c35-40b6-ba11-4b17cbd027ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f911a0-6b20-42cb-b0cc-8d2cb3bbd3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f911a0-6b20-42cb-b0cc-8d2cb3bbd3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420fd726-84d5-4266-8860-9065cd908ed7', 'volume_name': 'volume-420fd726-84d5-4266-8860-9065cd908ed7', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309fd00b-4ef9-48b9-b149-cffdd83054e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309fd00b-4ef9-48b9-b149-cffdd83054e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fdd6340-c8d2-4156-8140-0eab0438ee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:15 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Volume 420fd726-84d5-4266-8860-9065cd908ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420fd726-84d5-4266-8860-9065cd908ed7', 'volume_size': 1} Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae 1073741824" returned: 0 in 0.965s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:15 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae Jul 03 13:58:15 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:16 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae" returned: 0 in 0.647s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-734615725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420fd726-84d5-4266-8860-9065cd908ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5863c3c0fa44dd9e3a6332b24ca878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:15Z,use_quota=True,user_id='f9071a0f659b409897d736fdd4cc26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Creating volume 420fd726-84d5-4266-8860-9065cd908ed7 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:16 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-420fd726-84d5-4266-8860-9065cd908ed7 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:16 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-420fd726-84d5-4266-8860-9065cd908ed7 1073741824 Jul 03 13:58:16 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Attempting download of c72364f8-58c5-4ca3-8348-fe92aceb54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}])) to volume 2062f498-86c0-4ec6-b150-9d5fe0cd6bae. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[438cf20e-b124-40b6-98fd-e48ef1f939fe]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_de_2jmvw {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:16 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_de_2jmvw Jul 03 13:58:16 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:17 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_de_2jmvw" returned: 0 in 0.781s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_de_2jmvw {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:17 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-420fd726-84d5-4266-8860-9065cd908ed7 1073741824" returned: 0 in 0.897s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-420fd726-84d5-4266-8860-9065cd908ed7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:17 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-420fd726-84d5-4266-8860-9065cd908ed7 Jul 03 13:58:17 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:17 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_de_2jmvw Jul 03 13:58:17 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:17 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-420fd726-84d5-4266-8860-9065cd908ed7" returned: 0 in 0.680s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:17 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fdd6340-c8d2-4156-8140-0eab0438ee90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420fd726-84d5-4266-8860-9065cd908ed7', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827e7059-97b8-495a-b030-1ea17b69d5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_de_2jmvw" returned: 1 in 0.795s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c72364f8-58c5-4ca3-8348-fe92aceb54bd_de_2jmvw' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[835a0960-37eb-45d4-96f6-96cb2c16e9bb]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:17 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Volume volume-420fd726-84d5-4266-8860-9065cd908ed7 (420fd726-84d5-4266-8860-9065cd908ed7): created successfully Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827e7059-97b8-495a-b030-1ea17b69d5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Flow 'volume_create_manager' (1cf241ab-68a1-4bce-80b7-29d2aa14de79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-4726ec14-9bb9-4622-9cf6-77566480ab97 tempest-VolumesActionsTest-1162189829 None] Created volume successfully. Jul 03 13:58:18 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD Jul 03 13:58:18 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:18 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:18 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] c72364f8-58c5-4ca3-8348-fe92aceb54bd was qcow2, converting to raw {{(pid=86729) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 13:58:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:18 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae Jul 03 13:58:18 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Acquiring lock "cinder-420fd726-84d5-4266-8860-9065cd908ed7-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Lock "cinder-420fd726-84d5-4266-8860-9065cd908ed7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Acquiring lock "cinder-quobyte-420fd726-84d5-4266-8860-9065cd908ed7" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Lock "cinder-quobyte-420fd726-84d5-4266-8860-9065cd908ed7" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:18 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0048b4b-71df-42d8-9636-299279ca599b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-420fd726-84d5-4266-8860-9065cd908ed7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:19 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-420fd726-84d5-4266-8860-9065cd908ed7 Jul 03 13:58:19 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:19 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-420fd726-84d5-4266-8860-9065cd908ed7" returned: 0 in 0.988s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-420fd726-84d5-4266-8860-9065cd908ed7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:19 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-420fd726-84d5-4266-8860-9065cd908ed7 Jul 03 13:58:19 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:20 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-420fd726-84d5-4266-8860-9065cd908ed7" returned: 0 in 0.820s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Lock "cinder-quobyte-420fd726-84d5-4266-8860-9065cd908ed7" released by "delete_volume" :: held 1.872s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:20 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Created reservations ['af694bde-66fc-4b21-8cea-e9e0abb2707c', '9383b336-7cf4-43db-8403-01e819e57938', '3b5933fb-ef71-4078-ac40-7e0556e5f57a', 'cc563562-f4e9-4d58-acdd-8088ce30a8c6'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:20 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:58:20 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:21 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae" returned: 0 in 2.353s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:21 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c72364f8-58c5-4ca3-8348-fe92aceb54bd_62s9x8qtdevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:58:21 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Converted 112.00 MB image at 47.55 MB/s Jul 03 13:58:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:21 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae 1G Jul 03 13:58:21 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:21 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.838s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:21 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:21 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Deleted volume successfully. Jul 03 13:58:21 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d3619bfe-af08-4669-967f-6b887975f837 tempest-VolumesActionsTest-249330852 None] Lock "cinder-420fd726-84d5-4266-8860-9065cd908ed7-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:21 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae 1G" returned: 0 in 0.830s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:21 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[06732484-f68f-44c5-bf48-4a47bcdcf6b5]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:22 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae Jul 03 13:58:22 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Flow 'volume_create_manager' (33934822-cc2d-4b3b-90dd-e1a986bd5d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3154f8b-7f71-4d9d-a3b4-35874ef00b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3154f8b-7f71-4d9d-a3b4-35874ef00b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-660266405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e93308-a619-4ee5-ae94-7bd7044b3ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5863c3c0fa44dd9e3a6332b24ca878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:22Z,use_quota=True,user_id='f9071a0f659b409897d736fdd4cc26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc7faac-6e6b-44e8-b872-4bd7d59ecf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc7faac-6e6b-44e8-b872-4bd7d59ecf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b268a622-5331-4ce8-9367-b9c2a370428b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b268a622-5331-4ce8-9367-b9c2a370428b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e93308-a619-4ee5-ae94-7bd7044b3ef2', 'volume_name': 'volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01bdd2a-0ca8-47e6-8e89-9edc27b1d6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01bdd2a-0ca8-47e6-8e89-9edc27b1d6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ca6a01-2ec0-469b-8a95-ee87bba9ea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:22 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Volume 06e93308-a619-4ee5-ae94-7bd7044b3ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2', 'volume_size': 1} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-660266405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e93308-a619-4ee5-ae94-7bd7044b3ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5863c3c0fa44dd9e3a6332b24ca878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:22Z,use_quota=True,user_id='f9071a0f659b409897d736fdd4cc26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Creating volume 06e93308-a619-4ee5-ae94-7bd7044b3ef2 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:22 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:22 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2 1073741824 Jul 03 13:58:22 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:22 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae" returned: 0 in 0.778s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:22 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae Jul 03 13:58:22 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:23 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2 1073741824" returned: 0 in 0.963s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:23 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2 Jul 03 13:58:23 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:23 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae" returned: 1 in 0.798s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Downloaded image c72364f8-58c5-4ca3-8348-fe92aceb54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}])) to volume 2062f498-86c0-4ec6-b150-9d5fe0cd6bae successfully. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Temporary image c72364f8-58c5-4ca3-8348-fe92aceb54bd for user 626fe104ca474432a5a79f9105ced61f is deleted. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Marking volume 2062f498-86c0-4ec6-b150-9d5fe0cd6bae as bootable. {{(pid=86729) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Copying metadata from image c72364f8-58c5-4ca3-8348-fe92aceb54bd to 2062f498-86c0-4ec6-b150-9d5fe0cd6bae. {{(pid=86729) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Creating volume glance metadata for volume 2062f498-86c0-4ec6-b150-9d5fe0cd6bae backed by image c72364f8-58c5-4ca3-8348-fe92aceb54bd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86729) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730211ad-b187-4e21-8f5d-2e6d2d3a38cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae', 'volume_size': 1, 'image_id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '24c8a015e6c74647b59cf3465f3aee9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c72364f8-58c5-4ca3-8348-fe92aceb54bd', 'created_at': datetime.datetime(2026, 7, 3, 11, 40, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 40, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c72364f8-58c5-4ca3-8348-fe92aceb54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccf0210-3fa5-406c-9077-afb30c7f23c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:23 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Volume volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae (2062f498-86c0-4ec6-b150-9d5fe0cd6bae): created successfully Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccf0210-3fa5-406c-9077-afb30c7f23c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (195cddc5-727d-4f4b-8ab4-ea41368a4a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:23 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d2f5d1c0-b202-411b-8dd4-877a3db32e1b tempest-VolumesGetTest-1846123539 None] Created volume successfully. Jul 03 13:58:23 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2" returned: 0 in 0.696s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ca6a01-2ec0-469b-8a95-ee87bba9ea5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609c868f-d890-4fb6-acdc-dca313d58dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:23 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Volume volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2 (06e93308-a619-4ee5-ae94-7bd7044b3ef2): created successfully Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609c868f-d890-4fb6-acdc-dca313d58dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Flow 'volume_create_manager' (33934822-cc2d-4b3b-90dd-e1a986bd5d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:23 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-af48949a-64b1-40b1-9078-83159fb0bc7c tempest-VolumesActionsTest-1162189829 None] Created volume successfully. Jul 03 13:58:24 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Acquiring lock "cinder-06e93308-a619-4ee5-ae94-7bd7044b3ef2-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:24 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Lock "cinder-06e93308-a619-4ee5-ae94-7bd7044b3ef2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:24 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Acquiring lock "cinder-quobyte-06e93308-a619-4ee5-ae94-7bd7044b3ef2" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:24 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Lock "cinder-quobyte-06e93308-a619-4ee5-ae94-7bd7044b3ef2" acquired by "delete_volume" :: waited 0.013s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:24 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e40a3c-3cd7-48d5-8a7c-116e0f5cfa04]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:24 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2 Jul 03 13:58:24 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:25 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2" returned: 0 in 0.800s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:25 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2 Jul 03 13:58:25 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=90,cinder:UPDATE=113,cinder:DELETE=10,cinder:INSERT=33 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (90e6400b-8046-431e-9435-106920db6edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3966de0e-8055-4ccf-80a8-6acea34eaf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3966de0e-8055-4ccf-80a8-6acea34eaf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1171462489',display_name='tempest-VolumesGetTest-Volume-1103940708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038c769f-7857-4002-a227-91ee16cdd04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:26Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a144532-b13c-4907-b866-6dc4d66a8dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a144532-b13c-4907-b866-6dc4d66a8dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f16cab-3a82-479a-8e0f-b6b8293f5329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f16cab-3a82-479a-8e0f-b6b8293f5329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038c769f-7857-4002-a227-91ee16cdd04b', 'volume_name': 'volume-038c769f-7857-4002-a227-91ee16cdd04b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7b9313-3677-4883-9899-9889d24a01af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7b9313-3677-4883-9899-9889d24a01af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d26ba9b-f395-4230-bb7d-586f67abd9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:25 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Volume 038c769f-7857-4002-a227-91ee16cdd04b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038c769f-7857-4002-a227-91ee16cdd04b', 'volume_size': 1} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1171462489',display_name='tempest-VolumesGetTest-Volume-1103940708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038c769f-7857-4002-a227-91ee16cdd04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c8374941147eaad13dea773062b69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:26Z,use_quota=True,user_id='626fe104ca474432a5a79f9105ced61f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Creating volume 038c769f-7857-4002-a227-91ee16cdd04b {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:25 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-038c769f-7857-4002-a227-91ee16cdd04b 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:25 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-038c769f-7857-4002-a227-91ee16cdd04b 1073741824 Jul 03 13:58:25 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:25 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-06e93308-a619-4ee5-ae94-7bd7044b3ef2" returned: 0 in 0.799s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Lock "cinder-quobyte-06e93308-a619-4ee5-ae94-7bd7044b3ef2" released by "delete_volume" :: held 1.653s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:26 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:58:26 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Created reservations ['b49b75c9-7bf9-452c-8eca-4e8d1b192b09', '55d5ee9f-276c-418b-b5eb-f71093d1ef9f', '875b4eaf-652e-4459-bc0d-564ab2c3e9f3', '31520a16-a644-402e-bb27-acc630323af5'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:26 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:58:26 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:27 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.175s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:27 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-038c769f-7857-4002-a227-91ee16cdd04b 1073741824" returned: 0 in 1.692s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-038c769f-7857-4002-a227-91ee16cdd04b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:27 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-038c769f-7857-4002-a227-91ee16cdd04b Jul 03 13:58:27 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:27 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.121s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:27 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Deleted volume successfully. Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Flow 'volume_create_manager' (c034a702-0cc6-4b3d-b0b1-f70b9c43e6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7812170e-e535-409f-a947-eff3801d39de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-9e3a37a5-86da-4627-bea5-154de752c5db tempest-VolumesActionsTest-249330852 None] Lock "cinder-06e93308-a619-4ee5-ae94-7bd7044b3ef2-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7812170e-e535-409f-a947-eff3801d39de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1132652758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636b2508-653f-4626-9848-44b3c5c1b1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5863c3c0fa44dd9e3a6332b24ca878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:27Z,use_quota=True,user_id='f9071a0f659b409897d736fdd4cc26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888619aa-4bdf-4877-9349-957197df54af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888619aa-4bdf-4877-9349-957197df54af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a34bc39-d276-45c9-bfd1-402ed4e74e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a34bc39-d276-45c9-bfd1-402ed4e74e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '636b2508-653f-4626-9848-44b3c5c1b1aa', 'volume_name': 'volume-636b2508-653f-4626-9848-44b3c5c1b1aa', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd84adf-8169-4cc0-8850-fa9923d4ed8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd84adf-8169-4cc0-8850-fa9923d4ed8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1906bad8-7b0c-4168-8ce9-5501e9ab998b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:27 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Volume 636b2508-653f-4626-9848-44b3c5c1b1aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-636b2508-653f-4626-9848-44b3c5c1b1aa', 'volume_size': 1} Jul 03 13:58:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:28 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-038c769f-7857-4002-a227-91ee16cdd04b" returned: 0 in 0.957s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] <== create_volume: return (2715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.717s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1132652758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636b2508-653f-4626-9848-44b3c5c1b1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5863c3c0fa44dd9e3a6332b24ca878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:27Z,use_quota=True,user_id='f9071a0f659b409897d736fdd4cc26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Creating volume 636b2508-653f-4626-9848-44b3c5c1b1aa {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:28 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-636b2508-653f-4626-9848-44b3c5c1b1aa 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d26ba9b-f395-4230-bb7d-586f67abd9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038c769f-7857-4002-a227-91ee16cdd04b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:28 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-636b2508-653f-4626-9848-44b3c5c1b1aa 1073741824 Jul 03 13:58:28 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afba6453-dc1d-47ce-8f53-b62eb757cf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:28 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Volume volume-038c769f-7857-4002-a227-91ee16cdd04b (038c769f-7857-4002-a227-91ee16cdd04b): created successfully Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afba6453-dc1d-47ce-8f53-b62eb757cf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:28 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Flow 'volume_create_manager' (90e6400b-8046-431e-9435-106920db6edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:28 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-18fc31eb-cf20-4c93-86f3-1c7d9dff457d tempest-VolumesGetTest-1846123539 None] Created volume successfully. Jul 03 13:58:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-038c769f-7857-4002-a227-91ee16cdd04b-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Lock "cinder-038c769f-7857-4002-a227-91ee16cdd04b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-quobyte-038c769f-7857-4002-a227-91ee16cdd04b" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-038c769f-7857-4002-a227-91ee16cdd04b" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:29 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c629a712-6f28-4713-8483-a96022e84a90]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-038c769f-7857-4002-a227-91ee16cdd04b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:29 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-038c769f-7857-4002-a227-91ee16cdd04b Jul 03 13:58:29 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:29 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-636b2508-653f-4626-9848-44b3c5c1b1aa 1073741824" returned: 0 in 1.108s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-636b2508-653f-4626-9848-44b3c5c1b1aa {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:29 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-636b2508-653f-4626-9848-44b3c5c1b1aa Jul 03 13:58:29 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:30 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-038c769f-7857-4002-a227-91ee16cdd04b" returned: 0 in 0.932s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-038c769f-7857-4002-a227-91ee16cdd04b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:30 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-038c769f-7857-4002-a227-91ee16cdd04b Jul 03 13:58:30 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:30 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-636b2508-653f-4626-9848-44b3c5c1b1aa" returned: 0 in 0.871s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:30 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1906bad8-7b0c-4168-8ce9-5501e9ab998b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636b2508-653f-4626-9848-44b3c5c1b1aa', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:30 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ebb13ce-09ba-48ef-a438-4c16ed67fc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:30 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Volume volume-636b2508-653f-4626-9848-44b3c5c1b1aa (636b2508-653f-4626-9848-44b3c5c1b1aa): created successfully Jul 03 13:58:30 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ebb13ce-09ba-48ef-a438-4c16ed67fc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:30 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Flow 'volume_create_manager' (c034a702-0cc6-4b3d-b0b1-f70b9c43e6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:30 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-cea48087-15ca-4254-a249-b4f7aeefa2bf tempest-VolumesActionsTest-1162189829 None] Created volume successfully. Jul 03 13:58:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Acquiring lock "cinder-636b2508-653f-4626-9848-44b3c5c1b1aa-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:30 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-038c769f-7857-4002-a227-91ee16cdd04b" returned: 0 in 0.892s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Lock "cinder-636b2508-653f-4626-9848-44b3c5c1b1aa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-038c769f-7857-4002-a227-91ee16cdd04b" released by "delete_volume" :: held 1.901s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Acquiring lock "cinder-quobyte-636b2508-653f-4626-9848-44b3c5c1b1aa" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Lock "cinder-quobyte-636b2508-653f-4626-9848-44b3c5c1b1aa" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[698089bd-1a7f-4c01-8c76-3223b23192a9]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-636b2508-653f-4626-9848-44b3c5c1b1aa {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Created reservations ['5f2ca82b-0860-495a-ad70-694a75d2e42f', '1b8e77ef-a5f8-4073-b64d-9e9a68f9edf7', '89ae0fa1-4a99-42f0-a2f7-0b5e846aee94', '01ced349-8026-4b87-8833-98b6e49e0bfe'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:31 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-636b2508-653f-4626-9848-44b3c5c1b1aa Jul 03 13:58:31 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:31 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:58:31 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-2062f498-86c0-4ec6-b150-9d5fe0cd6bae-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Lock "cinder-2062f498-86c0-4ec6-b150-9d5fe0cd6bae-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Acquiring lock "cinder-quobyte-2062f498-86c0-4ec6-b150-9d5fe0cd6bae" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-2062f498-86c0-4ec6-b150-9d5fe0cd6bae" acquired by "delete_volume" :: waited 0.029s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a85469-6c94-4179-b3d4-aaabf985680c]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:31 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae Jul 03 13:58:31 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:32 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.006s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:32 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:32 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Deleted volume successfully. Jul 03 13:58:32 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-636b2508-653f-4626-9848-44b3c5c1b1aa" returned: 0 in 1.150s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-636b2508-653f-4626-9848-44b3c5c1b1aa {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-fa5f74c2-e9f6-4e8a-a83e-8daa1fe7cadc tempest-VolumesGetTest-1846123539 None] Lock "cinder-038c769f-7857-4002-a227-91ee16cdd04b-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:32 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-636b2508-653f-4626-9848-44b3c5c1b1aa Jul 03 13:58:32 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:32 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae" returned: 0 in 1.107s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:33 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-636b2508-653f-4626-9848-44b3c5c1b1aa" returned: 0 in 0.786s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:33 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae Jul 03 13:58:33 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Lock "cinder-quobyte-636b2508-653f-4626-9848-44b3c5c1b1aa" released by "delete_volume" :: held 1.989s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Created reservations ['b7e1bf54-13a8-4240-a9a8-0ef1965d9b27', '62d22f38-cf6a-43cc-8850-bbda59f25a0b', '6c95f744-f50d-4437-85a0-c24f40765988', 'b4fd3032-419e-4476-87c8-2a8e3842dc2b'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:33 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:58:33 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:33 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae" returned: 1 in 0.987s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:33 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae Jul 03 13:58:33 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:33 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Flow 'volume_create_manager' (230c015d-383a-40c9-a2f3-16a04527b8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3772b1-c2b4-44b9-8f46-097663cc9916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:34 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3772b1-c2b4-44b9-8f46-097663cc9916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1151908530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7e0a90-546e-434b-956b-ecb181399057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5863c3c0fa44dd9e3a6332b24ca878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:34Z,use_quota=True,user_id='f9071a0f659b409897d736fdd4cc26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62037f9d-e21c-4c51-a4b5-5ff45ad9444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62037f9d-e21c-4c51-a4b5-5ff45ad9444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21032869-6c46-4a1a-ba8a-8c091733b359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21032869-6c46-4a1a-ba8a-8c091733b359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf7e0a90-546e-434b-956b-ecb181399057', 'volume_name': 'volume-cf7e0a90-546e-434b-956b-ecb181399057', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913ba7a2-7df9-4316-bf29-60e344a80dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913ba7a2-7df9-4316-bf29-60e344a80dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e1bf16-4587-4da9-a809-c61efc031cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:34 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Volume cf7e0a90-546e-434b-956b-ecb181399057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf7e0a90-546e-434b-956b-ecb181399057', 'volume_size': 1} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1151908530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7e0a90-546e-434b-956b-ecb181399057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5863c3c0fa44dd9e3a6332b24ca878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:34Z,use_quota=True,user_id='f9071a0f659b409897d736fdd4cc26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Creating volume cf7e0a90-546e-434b-956b-ecb181399057 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:34 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cf7e0a90-546e-434b-956b-ecb181399057 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.941s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Deleted volume successfully. Jul 03 13:58:34 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cf7e0a90-546e-434b-956b-ecb181399057 1073741824 Jul 03 13:58:34 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-dc18faed-0a6e-4f89-ad2e-c77f0ec4ff60 tempest-VolumesActionsTest-249330852 None] Lock "cinder-636b2508-653f-4626-9848-44b3c5c1b1aa-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:34 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-2062f498-86c0-4ec6-b150-9d5fe0cd6bae" returned: 0 in 0.745s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Lock "cinder-quobyte-2062f498-86c0-4ec6-b150-9d5fe0cd6bae" released by "delete_volume" :: held 2.932s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Created reservations ['1d634d56-a3cb-4d51-8b07-03ad74c1c347', 'd85aba62-ebfd-4ce7-8692-49089c3f0f73', 'a75354be-cd3a-49bc-8dec-a4c4a9b94fa1', '16af03a8-246a-4a35-8cfe-42e2f40c3a20'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:34 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:58:34 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:35 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cf7e0a90-546e-434b-956b-ecb181399057 1073741824" returned: 0 in 0.976s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cf7e0a90-546e-434b-956b-ecb181399057 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:35 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cf7e0a90-546e-434b-956b-ecb181399057 Jul 03 13:58:35 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:35 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.783s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:35 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:35 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Deleted volume successfully. Jul 03 13:58:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bb06bb57-9b67-48dc-99d9-a46cd6fefed4 tempest-VolumesGetTest-1846123539 None] Lock "cinder-2062f498-86c0-4ec6-b150-9d5fe0cd6bae-delete_volume" released by "delete_volume" :: held 4.021s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:35 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cf7e0a90-546e-434b-956b-ecb181399057" returned: 0 in 0.854s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:35 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e1bf16-4587-4da9-a809-c61efc031cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf7e0a90-546e-434b-956b-ecb181399057', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c03cab1-7e3a-47a6-95d0-a01145ad0612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:36 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Volume volume-cf7e0a90-546e-434b-956b-ecb181399057 (cf7e0a90-546e-434b-956b-ecb181399057): created successfully Jul 03 13:58:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c03cab1-7e3a-47a6-95d0-a01145ad0612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Flow 'volume_create_manager' (230c015d-383a-40c9-a2f3-16a04527b8c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:36 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b3be6a96-beec-4725-a0b8-3f2e2cad14ab tempest-VolumesActionsTest-1162189829 None] Created volume successfully. Jul 03 13:58:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Acquiring lock "cinder-cf7e0a90-546e-434b-956b-ecb181399057-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Lock "cinder-cf7e0a90-546e-434b-956b-ecb181399057-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Acquiring lock "cinder-quobyte-cf7e0a90-546e-434b-956b-ecb181399057" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Lock "cinder-quobyte-cf7e0a90-546e-434b-956b-ecb181399057" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:37 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd9d661-3026-40a5-94d5-a8eeb8f35b4a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cf7e0a90-546e-434b-956b-ecb181399057 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:37 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cf7e0a90-546e-434b-956b-ecb181399057 Jul 03 13:58:37 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:38 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cf7e0a90-546e-434b-956b-ecb181399057" returned: 0 in 0.875s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cf7e0a90-546e-434b-956b-ecb181399057 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:38 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cf7e0a90-546e-434b-956b-ecb181399057 Jul 03 13:58:38 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:39 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cf7e0a90-546e-434b-956b-ecb181399057" returned: 0 in 0.813s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Lock "cinder-quobyte-cf7e0a90-546e-434b-956b-ecb181399057" released by "delete_volume" :: held 1.734s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:39 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Created reservations ['00ece7aa-932e-436c-b4cd-a1bb94059934', '3aca97c3-ba0e-4974-b84c-919eb9ce3eea', 'dcd77994-45fb-4c29-bbca-429b384d14f6', '2154e740-ac5b-47d5-ac41-46a6118c4483'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:39 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:58:39 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:40 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.944s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:40 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Deleted volume successfully. Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-56bf75a7-759c-4ced-9b18-9c061e55333d tempest-VolumesActionsTest-249330852 None] Lock "cinder-cf7e0a90-546e-434b-956b-ecb181399057-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Flow 'volume_create_manager' (aa6b18e0-67e5-4543-9127-77736401994c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88382f21-8fc2-4f1e-838b-6d7d882f9150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88382f21-8fc2-4f1e-838b-6d7d882f9150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-7049312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90291bba-8520-4cb4-95a8-d8279bc10ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5863c3c0fa44dd9e3a6332b24ca878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:40Z,use_quota=True,user_id='f9071a0f659b409897d736fdd4cc26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20aea9b0-67e1-4567-87ca-804dc787c4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20aea9b0-67e1-4567-87ca-804dc787c4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71df94e-9adb-42b8-a6ba-65b7f35b0890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71df94e-9adb-42b8-a6ba-65b7f35b0890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90291bba-8520-4cb4-95a8-d8279bc10ddc', 'volume_name': 'volume-90291bba-8520-4cb4-95a8-d8279bc10ddc', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a40a0e4-86d4-475a-a4be-f1b5917c3915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a40a0e4-86d4-475a-a4be-f1b5917c3915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ddf6bc-6f7a-4488-83d8-e48e682091cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:40 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Volume 90291bba-8520-4cb4-95a8-d8279bc10ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90291bba-8520-4cb4-95a8-d8279bc10ddc', 'volume_size': 1} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-7049312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90291bba-8520-4cb4-95a8-d8279bc10ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5863c3c0fa44dd9e3a6332b24ca878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:40Z,use_quota=True,user_id='f9071a0f659b409897d736fdd4cc26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Creating volume 90291bba-8520-4cb4-95a8-d8279bc10ddc {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:40 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:58:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90291bba-8520-4cb4-95a8-d8279bc10ddc 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:40 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90291bba-8520-4cb4-95a8-d8279bc10ddc 1073741824 Jul 03 13:58:40 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:41 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90291bba-8520-4cb4-95a8-d8279bc10ddc 1073741824" returned: 0 in 0.835s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90291bba-8520-4cb4-95a8-d8279bc10ddc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:41 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90291bba-8520-4cb4-95a8-d8279bc10ddc Jul 03 13:58:41 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:41 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90291bba-8520-4cb4-95a8-d8279bc10ddc" returned: 0 in 0.631s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ddf6bc-6f7a-4488-83d8-e48e682091cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90291bba-8520-4cb4-95a8-d8279bc10ddc', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891d0c12-4877-44cd-9626-4ee28c5972cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:41 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Volume volume-90291bba-8520-4cb4-95a8-d8279bc10ddc (90291bba-8520-4cb4-95a8-d8279bc10ddc): created successfully Jul 03 13:58:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891d0c12-4877-44cd-9626-4ee28c5972cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Flow 'volume_create_manager' (aa6b18e0-67e5-4543-9127-77736401994c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:41 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d632666c-9d10-4f1f-b17d-ccc3e18aa5f2 tempest-VolumesActionsTest-1162189829 None] Created volume successfully. Jul 03 13:58:43 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Acquiring lock "cinder-90291bba-8520-4cb4-95a8-d8279bc10ddc-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:43 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Lock "cinder-90291bba-8520-4cb4-95a8-d8279bc10ddc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:43 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Acquiring lock "cinder-quobyte-90291bba-8520-4cb4-95a8-d8279bc10ddc" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:43 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Lock "cinder-quobyte-90291bba-8520-4cb4-95a8-d8279bc10ddc" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:43 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d03ba87-28b4-48eb-b2d9-f527a9c1d2a4]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90291bba-8520-4cb4-95a8-d8279bc10ddc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:43 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90291bba-8520-4cb4-95a8-d8279bc10ddc Jul 03 13:58:43 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:43 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90291bba-8520-4cb4-95a8-d8279bc10ddc" returned: 0 in 0.802s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90291bba-8520-4cb4-95a8-d8279bc10ddc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:43 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90291bba-8520-4cb4-95a8-d8279bc10ddc Jul 03 13:58:43 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:44 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-90291bba-8520-4cb4-95a8-d8279bc10ddc" returned: 0 in 0.707s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Lock "cinder-quobyte-90291bba-8520-4cb4-95a8-d8279bc10ddc" released by "delete_volume" :: held 1.556s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:44 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Created reservations ['0faa0a4b-f894-4aa6-afbb-e21ab64d50db', '26a5e3c8-65a7-4ba4-a641-9f815b6850f0', '692d107a-a5e2-497e-90c6-24fa4b0cb11a', 'c83b1d51-d07b-4e6f-955b-18246ba67709'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:58:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:44 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:58:44 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:45 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.880s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:45 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:58:45 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Deleted volume successfully. Jul 03 13:58:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0325269f-93f9-439e-b337-863f2428edbf tempest-VolumesActionsTest-1162189829 None] Lock "cinder-90291bba-8520-4cb4-95a8-d8279bc10ddc-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Flow 'volume_create_manager' (bb2f8c30-88bf-4bd3-a9d4-1b918217fcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434b5b46-031c-4612-b505-046111528624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434b5b46-031c-4612-b505-046111528624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1196495061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7f989b-010d-4f21-90b2-369e50437bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f23138e147d420c9697e12cbcb21bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:49Z,use_quota=True,user_id='87066df84dee471dbea14acf854e5f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dfd4b1-e5b2-4825-8d4b-0d9498dec4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dfd4b1-e5b2-4825-8d4b-0d9498dec4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea47618f-2637-4b6e-99c9-aecb344e7f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea47618f-2637-4b6e-99c9-aecb344e7f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e7f989b-010d-4f21-90b2-369e50437bc1', 'volume_name': 'volume-7e7f989b-010d-4f21-90b2-369e50437bc1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3934e08-1974-47b0-a0a9-7673ece42fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3934e08-1974-47b0-a0a9-7673ece42fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb926fb-7aba-458c-9a54-09e67508d41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:49 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Volume 7e7f989b-010d-4f21-90b2-369e50437bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e7f989b-010d-4f21-90b2-369e50437bc1', 'volume_size': 1} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1196495061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7f989b-010d-4f21-90b2-369e50437bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f23138e147d420c9697e12cbcb21bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:58:49Z,use_quota=True,user_id='87066df84dee471dbea14acf854e5f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Creating volume 7e7f989b-010d-4f21-90b2-369e50437bc1 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:58:49 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:58:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:49 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 1073741824 Jul 03 13:58:49 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:50 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 1073741824" returned: 0 in 1.008s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:50 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 Jul 03 13:58:50 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:50 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1" returned: 0 in 0.764s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:58:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb926fb-7aba-458c-9a54-09e67508d41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e7f989b-010d-4f21-90b2-369e50437bc1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7c4eb1-9d3b-4c3f-9a17-0dba188f2330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:58:50 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Volume volume-7e7f989b-010d-4f21-90b2-369e50437bc1 (7e7f989b-010d-4f21-90b2-369e50437bc1): created successfully Jul 03 13:58:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7c4eb1-9d3b-4c3f-9a17-0dba188f2330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:58:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Flow 'volume_create_manager' (bb2f8c30-88bf-4bd3-a9d4-1b918217fcd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:58:51 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e70d839d-321e-4a23-97ca-b6d3aed9a651 tempest-VolumesSnapshotTestJSON-1270815957 None] Created volume successfully. Jul 03 13:58:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:58:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:58:52 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] Creating offline snapshot cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c of volume 7e7f989b-010d-4f21-90b2-369e50437bc1 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:58:52 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19611ea-e882-4276-af6b-8ccec4b6c770]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:52 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 Jul 03 13:58:52 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:53 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1" returned: 0 in 0.810s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:53 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c 1G Jul 03 13:58:53 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:54 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c 1G" returned: 0 in 1.181s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e7f989b-010d-4f21-90b2-369e50437bc1 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:54 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e7f989b-010d-4f21-90b2-369e50437bc1 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c Jul 03 13:58:54 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:55 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e7f989b-010d-4f21-90b2-369e50437bc1 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c" returned: 0 in 0.799s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:55 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c is being set with open permissions: ugo+rw Jul 03 13:58:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:55 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c Jul 03 13:58:55 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:55 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c" returned: 0 in 0.680s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:55 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=126,cinder:SELECT=98,cinder:INSERT=36,cinder:DELETE=13 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:58:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:56 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.info Jul 03 13:58:56 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:56 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.info" returned: 0 in 0.809s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:56 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.info is being set with open permissions: ugo+rw Jul 03 13:58:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:56 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.info Jul 03 13:58:56 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:57 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.info" returned: 0 in 0.640s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.026s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:58:57 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-39eb059c-5785-4c9e-a1a1-dcaca94a963e tempest-VolumesSnapshotTestJSON-1270815957 None] Create snapshot completed successfully Jul 03 13:58:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-7e7f989b-010d-4f21-90b2-369e50437bc1" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-7e7f989b-010d-4f21-90b2-369e50437bc1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:58:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:58:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Deleting offline snapshot cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c of volume 7e7f989b-010d-4f21-90b2-369e50437bc1 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:58:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] snapshot_file for this snap is: volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:58:58 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe9fdc9-f186-450e-ac19-447c4b92058b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:58 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c Jul 03 13:58:58 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:59 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c" returned: 0 in 1.068s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e7f989b-010d-4f21-90b2-369e50437bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:58:59 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[0855b8ba-307e-4af3-ba21-11052388020b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:58:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:58:59 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 Jul 03 13:58:59 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:58:59 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Jul 03 13:58:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1" returned: 0 in 0.840s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:58:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:00 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c Jul 03 13:59:00 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:00 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-5f6a3613-e046-4b99-aafc-8baa17b1c63d req-51e94c43-d641-4cb4-9436-8eef21b034d3 tempest-AttachVolumeNegativeTest-1456526646 None] Terminate volume connection completed successfully. Jul 03 13:59:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-5f6a3613-e046-4b99-aafc-8baa17b1c63d req-51e94c43-d641-4cb4-9436-8eef21b034d3 tempest-AttachVolumeNegativeTest-1456526646 None] Deleting attachment 4d20e299-e92a-44e0-8c9f-ade6578db3d0. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 13:59:00 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c" returned: 0 in 0.879s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:00 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c Jul 03 13:59:00 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Flow 'volume_create_manager' (d9c2bb6e-26a7-403a-b981-cc5a5ea8fbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48403ac5-3aa5-4f1d-860b-36f50fcc4c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48403ac5-3aa5-4f1d-860b-36f50fcc4c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-927920998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531ff246-07e7-42dd-b1c9-db9e144e6e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769fe67345da4eb1a5d43adafe6a8ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:01Z,use_quota=True,user_id='6d78fcc6973b44719a0622ff81888765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3876331-a26b-41d1-b734-844734e2daa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3876331-a26b-41d1-b734-844734e2daa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f82cb0-b3af-4b5b-ba00-1527a269bf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f82cb0-b3af-4b5b-ba00-1527a269bf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531ff246-07e7-42dd-b1c9-db9e144e6e76', 'volume_name': 'volume-531ff246-07e7-42dd-b1c9-db9e144e6e76', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc7bc7f-9bff-4085-82bd-c727a3d5c29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc7bc7f-9bff-4085-82bd-c727a3d5c29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e140c88c-c849-4bed-a783-3d9d7e47e506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:01 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Volume 531ff246-07e7-42dd-b1c9-db9e144e6e76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531ff246-07e7-42dd-b1c9-db9e144e6e76', 'volume_size': 1} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-927920998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531ff246-07e7-42dd-b1c9-db9e144e6e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769fe67345da4eb1a5d43adafe6a8ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:01Z,use_quota=True,user_id='6d78fcc6973b44719a0622ff81888765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Creating volume 531ff246-07e7-42dd-b1c9-db9e144e6e76 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:01 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:01 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 1073741824 Jul 03 13:59:01 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:01 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1.cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c" returned: 0 in 0.727s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c" released by "_delete_snapshot" :: held 3.653s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-7e7f989b-010d-4f21-90b2-369e50437bc1" released by "delete_snapshot" :: held 3.679s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Created reservations ['59f091e2-90ca-4e6c-861e-42242a4a6ed2', '7beb10c5-92b1-471d-be1c-03009bdf02f3', 'e05168b3-ee21-4850-8112-ef428fe15d2b', 'cdf7ea56-738c-40b5-a479-7037399e3d2a'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:01 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Delete snapshot completed successfully. Jul 03 13:59:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-018ad3ed-0032-434f-9f71-84e3a833d5b9 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-cd7f7f5d-a162-4531-ac1b-f8ac853d3b0c-delete_snapshot" released by "delete_snapshot" :: held 3.848s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:02 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 1073741824" returned: 0 in 0.913s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:02 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 Jul 03 13:59:02 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:02 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Flow 'volume_create_manager' (d48fa387-702d-49b2-9fd2-b400ceab462a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f083db-5c6b-4b7f-a038-3d89a0a4cb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f083db-5c6b-4b7f-a038-3d89a0a4cb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1485611524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595d135d-0c70-4992-8e52-5b616e0945a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f23138e147d420c9697e12cbcb21bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:03Z,use_quota=True,user_id='87066df84dee471dbea14acf854e5f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff34c75f-2374-440f-aa32-9329bb8d6cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff34c75f-2374-440f-aa32-9329bb8d6cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c473ff-29c5-4b77-a99a-be10c6596ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c473ff-29c5-4b77-a99a-be10c6596ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '595d135d-0c70-4992-8e52-5b616e0945a9', 'volume_name': 'volume-595d135d-0c70-4992-8e52-5b616e0945a9', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a229745-5f8b-48b3-b503-0a527ad914a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a229745-5f8b-48b3-b503-0a527ad914a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebabea08-0292-4678-96fd-e3f2eb7a028a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:03 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Volume 595d135d-0c70-4992-8e52-5b616e0945a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-595d135d-0c70-4992-8e52-5b616e0945a9', 'volume_size': 1} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:03 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76" returned: 0 in 0.697s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.085s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1485611524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595d135d-0c70-4992-8e52-5b616e0945a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f23138e147d420c9697e12cbcb21bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:03Z,use_quota=True,user_id='87066df84dee471dbea14acf854e5f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Creating volume 595d135d-0c70-4992-8e52-5b616e0945a9 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:03 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:03 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 1073741824 Jul 03 13:59:03 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e140c88c-c849-4bed-a783-3d9d7e47e506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531ff246-07e7-42dd-b1c9-db9e144e6e76', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49270faf-c26f-434f-a071-fbda673f88e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:03 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Volume volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 (531ff246-07e7-42dd-b1c9-db9e144e6e76): created successfully Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49270faf-c26f-434f-a071-fbda673f88e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Flow 'volume_create_manager' (d9c2bb6e-26a7-403a-b981-cc5a5ea8fbbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:03 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9e6b6cee-49cc-4107-9ad3-6d3028ded220 tempest-VolumesDeleteCascade-924145307 None] Created volume successfully. Jul 03 13:59:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:04 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 1073741824" returned: 0 in 1.026s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:04 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 Jul 03 13:59:04 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:04 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9" returned: 0 in 0.714s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:59:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.187s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebabea08-0292-4678-96fd-e3f2eb7a028a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595d135d-0c70-4992-8e52-5b616e0945a9', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9027d0d-880e-4323-b529-ce9a35f8393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] Creating offline snapshot 705e7d9b-7a63-4369-ba8e-99552a668185 of volume 531ff246-07e7-42dd-b1c9-db9e144e6e76 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:59:04 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Volume volume-595d135d-0c70-4992-8e52-5b616e0945a9 (595d135d-0c70-4992-8e52-5b616e0945a9): created successfully Jul 03 13:59:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9027d0d-880e-4323-b529-ce9a35f8393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Flow 'volume_create_manager' (d48fa387-702d-49b2-9fd2-b400ceab462a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:05 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68c7eb3-c490-460e-b31f-4f61c6cc8442]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-345d9ab5-e723-4d32-94aa-38dff909678a tempest-VolumesSnapshotTestJSON-1270815957 None] Created volume successfully. Jul 03 13:59:05 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 Jul 03 13:59:05 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:05 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76" returned: 0 in 0.764s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:05 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 1G Jul 03 13:59:05 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:06 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 1G" returned: 0 in 0.847s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:06 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 Jul 03 13:59:06 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:07 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185" returned: 0 in 0.658s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:07 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 is being set with open permissions: ugo+rw Jul 03 13:59:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:07 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 Jul 03 13:59:07 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:07 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185" returned: 0 in 0.678s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:08 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.info Jul 03 13:59:08 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:08 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.info" returned: 0 in 0.683s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:08 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.info is being set with open permissions: ugo+rw Jul 03 13:59:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:08 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.info Jul 03 13:59:08 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:09 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.info" returned: 0 in 0.675s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.418s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.086s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] Creating offline snapshot ee53cf00-3321-4588-9be6-dcbc06d33f25 of volume 595d135d-0c70-4992-8e52-5b616e0945a9 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:59:09 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d2114fb8-d60c-4316-a9a2-bc22dc043177 tempest-VolumesDeleteCascade-924145307 None] Create snapshot completed successfully Jul 03 13:59:09 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[837701e7-7a58-42a6-a41e-00291c2e1775]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:09 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 Jul 03 13:59:09 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:10 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9" returned: 0 in 0.864s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:10 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 1G Jul 03 13:59:10 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:11 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 1G" returned: 0 in 0.935s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-595d135d-0c70-4992-8e52-5b616e0945a9 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:11 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-595d135d-0c70-4992-8e52-5b616e0945a9 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 Jul 03 13:59:11 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:11 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-595d135d-0c70-4992-8e52-5b616e0945a9 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25" returned: 0 in 0.748s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:11 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 is being set with open permissions: ugo+rw Jul 03 13:59:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:11 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 Jul 03 13:59:11 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:12 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25" returned: 0 in 0.665s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:12 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.info Jul 03 13:59:12 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:13 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.info" returned: 0 in 0.665s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:13 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.info is being set with open permissions: ugo+rw Jul 03 13:59:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:13 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.info Jul 03 13:59:13 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:13 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.info" returned: 0 in 0.664s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.650s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.856s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] Creating offline snapshot 443c7527-644b-4204-9b39-c020435a0d2b of volume 531ff246-07e7-42dd-b1c9-db9e144e6e76 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:59:14 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-89d5142f-8629-4c57-8073-360c0303a1ba tempest-VolumesSnapshotTestJSON-1270815957 None] Create snapshot completed successfully Jul 03 13:59:14 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ac0f4a-477e-4b86-aaa2-1c3e8bfb2802]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:14 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 Jul 03 13:59:14 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:14 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185" returned: 0 in 0.794s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-531ff246-07e7-42dd-b1c9-db9e144e6e76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:59:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:14 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b 1G Jul 03 13:59:14 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Flow 'volume_create_manager' (204e3e92-3cc3-401b-83d0-63d59d89c1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2704d7-6886-4873-ab1e-3115dc699ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2704d7-6886-4873-ab1e-3115dc699ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1933597780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b421b772-0d4e-4596-95e1-3a0815a42ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f23138e147d420c9697e12cbcb21bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ee53cf00-3321-4588-9be6-dcbc06d33f25,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:15Z,use_quota=True,user_id='87066df84dee471dbea14acf854e5f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2054310-17c6-4225-a075-626c9d251a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2054310-17c6-4225-a075-626c9d251a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c99ee15-34af-4f3d-9e08-d4d8c82bbb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c99ee15-34af-4f3d-9e08-d4d8c82bbb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b421b772-0d4e-4596-95e1-3a0815a42ae4', 'volume_name': 'volume-b421b772-0d4e-4596-95e1-3a0815a42ae4', 'volume_size': 2, 'snapshot_id': 'ee53cf00-3321-4588-9be6-dcbc06d33f25'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70478dae-6d49-48be-a3ec-cc07f130909f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70478dae-6d49-48be-a3ec-cc07f130909f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf64130-3aa4-45b8-8985-a8843a38e605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:15 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Volume b421b772-0d4e-4596-95e1-3a0815a42ae4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b421b772-0d4e-4596-95e1-3a0815a42ae4', 'volume_size': 2, 'snapshot_id': 'ee53cf00-3321-4588-9be6-dcbc06d33f25'} Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:15 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b 1G" returned: 0 in 0.822s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:15 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b Jul 03 13:59:15 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:16 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b" returned: 0 in 0.705s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:16 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b is being set with open permissions: ugo+rw Jul 03 13:59:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:16 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b Jul 03 13:59:16 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:17 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b" returned: 0 in 0.634s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.086s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.794s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-ee53cf00-3321-4588-9be6-dcbc06d33f25-b421b772-0d4e-4596-95e1-3a0815a42ae4" by "_create_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-ee53cf00-3321-4588-9be6-dcbc06d33f25-b421b772-0d4e-4596-95e1-3a0815a42ae4" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Creating volume b421b772-0d4e-4596-95e1-3a0815a42ae4 from snapshot ee53cf00-3321-4588-9be6-dcbc06d33f25 {{(pid=86729) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-b421b772-0d4e-4596-95e1-3a0815a42ae4" by "_copy_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9b48129f-e48f-43c3-bfba-29381e220306 tempest-VolumesDeleteCascade-924145307 None] Create snapshot completed successfully Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-b421b772-0d4e-4596-95e1-3a0815a42ae4" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] snapshot: ee53cf00-3321-4588-9be6-dcbc06d33f25, volume: b421b772-0d4e-4596-95e1-3a0815a42ae4, {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a352651-f23a-42de-baf4-b6d43f2c6d7f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:17 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 Jul 03 13:59:17 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-531ff246-07e7-42dd-b1c9-db9e144e6e76-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-531ff246-07e7-42dd-b1c9-db9e144e6e76-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Performing cascade delete. {{(pid=86729) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-443c7527-644b-4204-9b39-c020435a0d2b-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-443c7527-644b-4204-9b39-c020435a0d2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-quobyte-531ff246-07e7-42dd-b1c9-db9e144e6e76" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-531ff246-07e7-42dd-b1c9-db9e144e6e76" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-quobyte-443c7527-644b-4204-9b39-c020435a0d2b" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-443c7527-644b-4204-9b39-c020435a0d2b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Deleting offline snapshot 443c7527-644b-4204-9b39-c020435a0d2b of volume 531ff246-07e7-42dd-b1c9-db9e144e6e76 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] snapshot_file for this snap is: volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec2246d-efa2-4e4f-9c1c-8ddf58c1a6cb]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:17 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b Jul 03 13:59:17 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:17 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25" returned: 0 in 0.781s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-595d135d-0c70-4992-8e52-5b616e0945a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:59:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] will copy from snapshot at /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:59:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Creating direct copy from snapshot {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:59:18 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82281de-baa8-40e4-92f6-4294bca5847b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:18 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 Jul 03 13:59:18 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:18 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b" returned: 0 in 0.824s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-531ff246-07e7-42dd-b1c9-db9e144e6e76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:59:18 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e894f7-a6c1-4652-a26c-045c557667e4]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:18 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 Jul 03 13:59:18 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:18 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9" returned: 0 in 0.834s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:18 devstack cinder-volume[86729]: DEBUG cinder.utils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Path /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4 not found in is_blk_device check {{(pid=86729) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:59:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:18 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4 Jul 03 13:59:18 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:19 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185" returned: 0 in 0.957s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-531ff246-07e7-42dd-b1c9-db9e144e6e76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:59:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:19 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b Jul 03 13:59:19 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:22 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b" returned: 0 in 2.497s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:22 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b Jul 03 13:59:22 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:23 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.443c7527-644b-4204-9b39-c020435a0d2b" returned: 0 in 1.279s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-443c7527-644b-4204-9b39-c020435a0d2b" released by "_delete_snapshot" :: held 5.727s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-531ff246-07e7-42dd-b1c9-db9e144e6e76" released by "delete_snapshot" :: held 5.758s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Created reservations ['45487e56-e598-465b-bba3-ec2c8b976d72', 'b70da16f-fc56-4a74-9632-33a21f2c702e', 'bdc562e1-ec36-47ec-ac1c-18d00f1a6412', 'b6e7dc56-fc24-409d-81e1-e83a0fb50751'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:23 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Delete snapshot completed successfully. Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-443c7527-644b-4204-9b39-c020435a0d2b-delete_snapshot" released by "delete_snapshot" :: held 6.047s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-705e7d9b-7a63-4369-ba8e-99552a668185-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-705e7d9b-7a63-4369-ba8e-99552a668185-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-quobyte-531ff246-07e7-42dd-b1c9-db9e144e6e76" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-531ff246-07e7-42dd-b1c9-db9e144e6e76" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-quobyte-705e7d9b-7a63-4369-ba8e-99552a668185" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-705e7d9b-7a63-4369-ba8e-99552a668185" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Deleting offline snapshot 705e7d9b-7a63-4369-ba8e-99552a668185 of volume 531ff246-07e7-42dd-b1c9-db9e144e6e76 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] snapshot_file for this snap is: volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7bdde9-d1a3-4f2e-8f86-d82259a97bed]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:24 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 Jul 03 13:59:24 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:24 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4" returned: 0 in 5.622s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:24 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[77131cc0-53b7-4168-96ab-3cd258494a59]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:24 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 Jul 03 13:59:24 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:25 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185" returned: 0 in 1.056s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-531ff246-07e7-42dd-b1c9-db9e144e6e76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:59:25 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f8531c-d990-4454-9c6b-1c8993bac99b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:25 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 Jul 03 13:59:25 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:25 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9" returned: 0 in 1.011s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:25 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:59:25 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Converted 1024.00 MB image at 182.10 MB/s Jul 03 13:59:25 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4 is being set with open permissions: ugo+rw Jul 03 13:59:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:25 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4 Jul 03 13:59:25 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:25 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76" returned: 0 in 0.780s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:25 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 Jul 03 13:59:25 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:25 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=79,cinder:INSERT=17,cinder:UPDATE=91,cinder:DELETE=7 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:59:25 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:26 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:59:26 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:26 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4" returned: 0 in 0.668s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-b421b772-0d4e-4596-95e1-3a0815a42ae4" released by "_copy_volume_from_snapshot" :: held 9.023s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-ee53cf00-3321-4588-9be6-dcbc06d33f25-b421b772-0d4e-4596-95e1-3a0815a42ae4" released by "_create_volume_from_snapshot" :: held 9.059s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.085s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf64130-3aa4-45b8-8985-a8843a38e605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b421b772-0d4e-4596-95e1-3a0815a42ae4', 'volume_size': 2, 'snapshot_id': 'ee53cf00-3321-4588-9be6-dcbc06d33f25'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef634902-8526-48ba-a71f-0489ef21f301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:26 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Volume volume-b421b772-0d4e-4596-95e1-3a0815a42ae4 (b421b772-0d4e-4596-95e1-3a0815a42ae4): created successfully Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef634902-8526-48ba-a71f-0489ef21f301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Flow 'volume_create_manager' (204e3e92-3cc3-401b-83d0-63d59d89c1d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:26 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-bc2c5f8e-1852-43b2-a7df-2cfa38061fe3 tempest-VolumesSnapshotTestJSON-1270815957 None] Created volume successfully. Jul 03 13:59:26 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185" returned: 0 in 0.817s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:26 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185 Jul 03 13:59:26 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:26 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.694s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:59:27 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76.705e7d9b-7a63-4369-ba8e-99552a668185" returned: 0 in 0.638s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-b421b772-0d4e-4596-95e1-3a0815a42ae4-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-705e7d9b-7a63-4369-ba8e-99552a668185" released by "_delete_snapshot" :: held 3.453s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-531ff246-07e7-42dd-b1c9-db9e144e6e76" released by "delete_snapshot" :: held 3.502s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-b421b772-0d4e-4596-95e1-3a0815a42ae4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-b421b772-0d4e-4596-95e1-3a0815a42ae4" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-b421b772-0d4e-4596-95e1-3a0815a42ae4" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c23dda-5181-4499-ac98-c5d22f19e857]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Created reservations ['e8742864-3ad4-4ef3-b27e-c0e42aedbea7', '9236bcc0-5b8d-44ad-a188-b59b68f130cb', 'e56fa3a5-7779-441c-b0d7-fe732998fec8', 'e0cef602-7cd5-4d4f-a2cd-10bbd56d0198'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:27 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Delete snapshot completed successfully. Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-705e7d9b-7a63-4369-ba8e-99552a668185-delete_snapshot" released by "delete_snapshot" :: held 3.746s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Snapshots deleted, issuing volume delete {{(pid=86729) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-quobyte-531ff246-07e7-42dd-b1c9-db9e144e6e76" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-531ff246-07e7-42dd-b1c9-db9e144e6e76" acquired by "delete_volume" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:27 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4 Jul 03 13:59:27 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f335771-33e8-4dbb-9f4a-33a9950ce2e4]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:27 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 Jul 03 13:59:27 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:28 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4" returned: 0 in 0.880s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:28 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4 Jul 03 13:59:28 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:28 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76" returned: 0 in 1.058s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:28 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76 Jul 03 13:59:28 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:29 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b421b772-0d4e-4596-95e1-3a0815a42ae4" returned: 0 in 1.236s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:29 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-531ff246-07e7-42dd-b1c9-db9e144e6e76" returned: 0 in 0.940s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-b421b772-0d4e-4596-95e1-3a0815a42ae4" released by "delete_volume" :: held 2.210s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-531ff246-07e7-42dd-b1c9-db9e144e6e76" released by "delete_volume" :: held 2.111s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Created reservations ['546f8b72-bad5-4d3d-9a48-7995c5ba2f23', '6a3c6929-c493-40c5-8f53-a420adc442cf', '003a2308-5013-4695-8ac5-73fd409b0d45', '866b6809-241d-4186-a1e1-8cbed19f0dae'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Created reservations ['04672ec3-737c-4bb7-a7b4-750b41ebfc84', 'eb2a86a1-c1ad-4697-8eb1-627897e15e39', '8004854f-ee7e-4a59-b776-6ce269d32875', '10c384ee-01a3-4bc0-bb62-917428970064'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:29 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:59:29 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:29 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:59:29 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:30 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-ee53cf00-3321-4588-9be6-dcbc06d33f25-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.158s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:30 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:59:30 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Deleted volume successfully. Jul 03 13:59:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-ee53cf00-3321-4588-9be6-dcbc06d33f25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-595d135d-0c70-4992-8e52-5b616e0945a9" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Flow 'volume_create_manager' (f75be59d-a648-4d32-9a14-0ea7c561eca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8333f017-112d-45f2-9a59-79e544c9fa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:31 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-84699025-07f7-4eaf-bd9f-e1a95ba14321 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-531ff246-07e7-42dd-b1c9-db9e144e6e76-delete_volume" released by "delete_volume" :: held 13.505s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-595d135d-0c70-4992-8e52-5b616e0945a9" acquired by "delete_snapshot" :: waited 0.078s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-ee53cf00-3321-4588-9be6-dcbc06d33f25" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8333f017-112d-45f2-9a59-79e544c9fa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1651382271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c49ff2-92c0-4ad7-a487-52290380c5a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769fe67345da4eb1a5d43adafe6a8ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:31Z,use_quota=True,user_id='6d78fcc6973b44719a0622ff81888765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7922ac19-1d95-41f5-b66a-baf78f72c3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7922ac19-1d95-41f5-b66a-baf78f72c3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a813f8-f016-4764-b330-b7ab3da709a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a813f8-f016-4764-b330-b7ab3da709a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c49ff2-92c0-4ad7-a487-52290380c5a0', 'volume_name': 'volume-41c49ff2-92c0-4ad7-a487-52290380c5a0', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792fb9c8-72c8-4387-9612-4c062c7c2434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792fb9c8-72c8-4387-9612-4c062c7c2434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284f2f71-cc9e-44ee-9bdb-1da075f3d40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:31 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Volume 41c49ff2-92c0-4ad7-a487-52290380c5a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c49ff2-92c0-4ad7-a487-52290380c5a0', 'volume_size': 1} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1651382271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c49ff2-92c0-4ad7-a487-52290380c5a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769fe67345da4eb1a5d43adafe6a8ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:31Z,use_quota=True,user_id='6d78fcc6973b44719a0622ff81888765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Creating volume 41c49ff2-92c0-4ad7-a487-52290380c5a0 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:31 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.271s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:59:31 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Deleted volume successfully. Jul 03 13:59:31 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 1073741824 Jul 03 13:59:31 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-ee53cf00-3321-4588-9be6-dcbc06d33f25" acquired by "_delete_snapshot" :: waited 0.119s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Deleting offline snapshot ee53cf00-3321-4588-9be6-dcbc06d33f25 of volume 595d135d-0c70-4992-8e52-5b616e0945a9 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] snapshot_file for this snap is: volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac89b328-c7f1-49c2-b413-2ca3e30fd374]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-087f614a-7314-45bc-862e-97c79271b4e9 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-b421b772-0d4e-4596-95e1-3a0815a42ae4-delete_volume" released by "delete_volume" :: held 3.989s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:31 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 Jul 03 13:59:31 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:32 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 1073741824" returned: 0 in 1.114s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:32 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 Jul 03 13:59:32 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:32 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25" returned: 0 in 1.264s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-595d135d-0c70-4992-8e52-5b616e0945a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:59:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6096f703-026f-4d0e-a600-d4a71f558c0c]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:32 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 Jul 03 13:59:32 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:33 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0" returned: 0 in 0.906s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:59:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284f2f71-cc9e-44ee-9bdb-1da075f3d40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c49ff2-92c0-4ad7-a487-52290380c5a0', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacb3a2d-c6f3-4f66-a158-a9b32da6e1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:33 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Volume volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 (41c49ff2-92c0-4ad7-a487-52290380c5a0): created successfully Jul 03 13:59:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacb3a2d-c6f3-4f66-a158-a9b32da6e1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Flow 'volume_create_manager' (f75be59d-a648-4d32-9a14-0ea7c561eca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:33 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-8528ee8b-6bda-417a-b7f8-5d609575a862 tempest-VolumesDeleteCascade-924145307 None] Created volume successfully. Jul 03 13:59:33 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9" returned: 0 in 0.984s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:33 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 Jul 03 13:59:33 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] Creating offline snapshot c707f185-1c97-469b-805e-cb0fbbbc1c07 of volume 41c49ff2-92c0-4ad7-a487-52290380c5a0 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:59:34 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a2c0cb-95da-45c2-8ddd-11aaae484dc5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:34 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 Jul 03 13:59:34 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:34 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25" returned: 0 in 0.903s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:34 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25 Jul 03 13:59:34 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:35 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0" returned: 0 in 0.755s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:35 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 1G Jul 03 13:59:35 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:35 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9.ee53cf00-3321-4588-9be6-dcbc06d33f25" returned: 0 in 0.677s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-ee53cf00-3321-4588-9be6-dcbc06d33f25" released by "_delete_snapshot" :: held 4.003s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-595d135d-0c70-4992-8e52-5b616e0945a9" released by "delete_snapshot" :: held 4.132s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:35 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Created reservations ['82336515-4c88-4f7b-9a02-0988656a31a3', '478e76c8-d00e-44f7-b24e-2d4bc0650794', '13c865ce-5f02-4cde-a521-4b9cc6f92e88', '5bcfb2f0-c174-4bbe-998a-b7f3cc8f593a'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:35 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Delete snapshot completed successfully. Jul 03 13:59:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-25f84f18-ee87-499e-a445-b320e6763560 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-ee53cf00-3321-4588-9be6-dcbc06d33f25-delete_snapshot" released by "delete_snapshot" :: held 4.350s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:35 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 1G" returned: 0 in 0.779s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:35 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 Jul 03 13:59:35 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-595d135d-0c70-4992-8e52-5b616e0945a9-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-595d135d-0c70-4992-8e52-5b616e0945a9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-595d135d-0c70-4992-8e52-5b616e0945a9" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-595d135d-0c70-4992-8e52-5b616e0945a9" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:36 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f598ebae-d87d-4256-a42e-f98d508af95c]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:36 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 Jul 03 13:59:36 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:36 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07" returned: 0 in 0.743s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:36 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 is being set with open permissions: ugo+rw Jul 03 13:59:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:36 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 Jul 03 13:59:36 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:37 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9" returned: 0 in 0.750s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:37 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9 Jul 03 13:59:37 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:37 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07" returned: 0 in 0.718s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:37 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.info Jul 03 13:59:37 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:37 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-595d135d-0c70-4992-8e52-5b616e0945a9" returned: 0 in 0.657s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-595d135d-0c70-4992-8e52-5b616e0945a9" released by "delete_volume" :: held 1.473s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:37 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Created reservations ['2fbdbfb9-66f9-4d5c-ab89-cd0d086b3ec4', 'd7c7acea-871e-41d6-80e4-67f05dd09230', '6fac2120-3796-46e9-8565-0571a075ec29', 'af5e6530-c206-4135-8d03-48d92dac4370'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:38 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:59:38 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:38 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.info" returned: 0 in 0.729s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:38 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.info is being set with open permissions: ugo+rw Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:38 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.info Jul 03 13:59:38 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:38 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.743s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:59:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Deleted volume successfully. Jul 03 13:59:38 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.info" returned: 0 in 0.708s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.552s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d04780a-96df-4948-989f-5c5a2119d6e8 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-595d135d-0c70-4992-8e52-5b616e0945a9-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c2f52353-7ab3-4589-a672-a75a91aa4369 tempest-VolumesDeleteCascade-924145307 None] Create snapshot completed successfully Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Flow 'volume_create_manager' (1fb97b30-6e38-4b3b-be2c-cfbbc9cc8119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08b41e7-6853-44ce-a358-5ac3852e9bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08b41e7-6853-44ce-a358-5ac3852e9bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-580724438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0506b7e2-4ea0-46c1-9b7b-bf812da99a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f23138e147d420c9697e12cbcb21bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:39Z,use_quota=True,user_id='87066df84dee471dbea14acf854e5f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0dbde3-a7cf-423b-a1c1-9942c5ba66fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0dbde3-a7cf-423b-a1c1-9942c5ba66fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ea0bc5-f22a-46c8-a9b6-fc46307b3007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ea0bc5-f22a-46c8-a9b6-fc46307b3007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0506b7e2-4ea0-46c1-9b7b-bf812da99a37', 'volume_name': 'volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823a774f-dca0-40d3-a7fa-7faf410ff460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823a774f-dca0-40d3-a7fa-7faf410ff460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b591869d-1055-4c1e-afc2-39795a235c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:39 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Volume 0506b7e2-4ea0-46c1-9b7b-bf812da99a37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37', 'volume_size': 1} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-580724438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0506b7e2-4ea0-46c1-9b7b-bf812da99a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f23138e147d420c9697e12cbcb21bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:39Z,use_quota=True,user_id='87066df84dee471dbea14acf854e5f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Creating volume 0506b7e2-4ea0-46c1-9b7b-bf812da99a37 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:39 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:59:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:39 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 1073741824 Jul 03 13:59:39 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Flow 'volume_create_manager' (db82a149-d9f9-4f85-aa4b-be09eaf981fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f29967-f2d1-41c1-877c-0a1c48f1c6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f29967-f2d1-41c1-877c-0a1c48f1c6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2120689006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c230a39-d9c1-4a43-9582-507c2135e440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769fe67345da4eb1a5d43adafe6a8ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c707f185-1c97-469b-805e-cb0fbbbc1c07,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:40Z,use_quota=True,user_id='6d78fcc6973b44719a0622ff81888765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f9f3bd-43e1-4319-b791-f1717a4fd2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f9f3bd-43e1-4319-b791-f1717a4fd2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b0a9e2-e058-4c25-8548-218cb9816095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b0a9e2-e058-4c25-8548-218cb9816095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c230a39-d9c1-4a43-9582-507c2135e440', 'volume_name': 'volume-5c230a39-d9c1-4a43-9582-507c2135e440', 'volume_size': 1, 'snapshot_id': 'c707f185-1c97-469b-805e-cb0fbbbc1c07'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbb0d18-1ff9-49c0-98e9-6ea2e03a17dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbb0d18-1ff9-49c0-98e9-6ea2e03a17dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ff58ed-377a-4c5c-b49f-41af746453a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:40 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Volume 5c230a39-d9c1-4a43-9582-507c2135e440: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c230a39-d9c1-4a43-9582-507c2135e440', 'volume_size': 1, 'snapshot_id': 'c707f185-1c97-469b-805e-cb0fbbbc1c07'} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:40 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 1073741824" returned: 0 in 0.923s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:40 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 Jul 03 13:59:40 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:40 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" returned: 0 in 0.690s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.750s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-quobyte-c707f185-1c97-469b-805e-cb0fbbbc1c07-5c230a39-d9c1-4a43-9582-507c2135e440" by "_create_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b591869d-1055-4c1e-afc2-39795a235c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7212bb1-f74c-4baa-b5dd-4a0323e9fbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-c707f185-1c97-469b-805e-cb0fbbbc1c07-5c230a39-d9c1-4a43-9582-507c2135e440" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Creating volume 5c230a39-d9c1-4a43-9582-507c2135e440 from snapshot c707f185-1c97-469b-805e-cb0fbbbc1c07 {{(pid=86729) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-quobyte-5c230a39-d9c1-4a43-9582-507c2135e440" by "_copy_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:41 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Volume volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 (0506b7e2-4ea0-46c1-9b7b-bf812da99a37): created successfully Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7212bb1-f74c-4baa-b5dd-4a0323e9fbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Flow 'volume_create_manager' (1fb97b30-6e38-4b3b-be2c-cfbbc9cc8119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-5c230a39-d9c1-4a43-9582-507c2135e440" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] snapshot: c707f185-1c97-469b-805e-cb0fbbbc1c07, volume: 5c230a39-d9c1-4a43-9582-507c2135e440, {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:41 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-aac5fecb-e140-4f7e-bde3-de19165a350b tempest-VolumesSnapshotTestJSON-1270815957 None] Created volume successfully. Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3cd6d3-d23e-4e5b-a45a-c62be121c81c]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:41 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 Jul 03 13:59:41 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:41 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07" returned: 0 in 0.804s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41c49ff2-92c0-4ad7-a487-52290380c5a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Creating direct copy from snapshot {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea653b83-be03-4fd4-a61f-66c903057845]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:42 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 Jul 03 13:59:42 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:42 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0" returned: 0 in 0.732s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:42 devstack cinder-volume[86729]: DEBUG cinder.utils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Path /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440 not found in is_blk_device check {{(pid=86729) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:59:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:42 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440 Jul 03 13:59:42 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:47 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440" returned: 0 in 4.405s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d8e156-9dd9-44bd-a267-dba97c38e2d9]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:47 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 Jul 03 13:59:47 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:48 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0" returned: 0 in 0.930s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 13:59:48 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Converted 1024.00 MB image at 232.38 MB/s Jul 03 13:59:48 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440 is being set with open permissions: ugo+rw Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:48 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440 Jul 03 13:59:48 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:48 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440" returned: 0 in 0.630s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-5c230a39-d9c1-4a43-9582-507c2135e440" released by "_copy_volume_from_snapshot" :: held 7.600s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-c707f185-1c97-469b-805e-cb0fbbbc1c07-5c230a39-d9c1-4a43-9582-507c2135e440" released by "_create_volume_from_snapshot" :: held 7.653s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.697s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.204s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] Creating offline snapshot a9fdd441-0249-40ea-96e4-b39a12b91de1 of volume 0506b7e2-4ea0-46c1-9b7b-bf812da99a37 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1855d9d-63b1-4922-98e6-ea757b2475f2]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ff58ed-377a-4c5c-b49f-41af746453a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c230a39-d9c1-4a43-9582-507c2135e440', 'volume_size': 1, 'snapshot_id': 'c707f185-1c97-469b-805e-cb0fbbbc1c07'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984b3508-0e36-4ea5-962e-c23b4e628615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:48 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Volume volume-5c230a39-d9c1-4a43-9582-507c2135e440 (5c230a39-d9c1-4a43-9582-507c2135e440): created successfully Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984b3508-0e36-4ea5-962e-c23b4e628615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Flow 'volume_create_manager' (db82a149-d9f9-4f85-aa4b-be09eaf981fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:48 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-cf01491d-6dd7-49a0-8b8b-96ac48d082d7 tempest-VolumesDeleteCascade-924145307 None] Created volume successfully. Jul 03 13:59:48 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 Jul 03 13:59:48 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:49 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" returned: 0 in 0.717s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:49 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 1G Jul 03 13:59:49 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-41c49ff2-92c0-4ad7-a487-52290380c5a0-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-41c49ff2-92c0-4ad7-a487-52290380c5a0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Performing cascade delete. {{(pid=86729) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 13:59:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-c707f185-1c97-469b-805e-cb0fbbbc1c07-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-c707f185-1c97-469b-805e-cb0fbbbc1c07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-quobyte-41c49ff2-92c0-4ad7-a487-52290380c5a0" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-41c49ff2-92c0-4ad7-a487-52290380c5a0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-quobyte-c707f185-1c97-469b-805e-cb0fbbbc1c07" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-c707f185-1c97-469b-805e-cb0fbbbc1c07" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Deleting offline snapshot c707f185-1c97-469b-805e-cb0fbbbc1c07 of volume 41c49ff2-92c0-4ad7-a487-52290380c5a0 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] snapshot_file for this snap is: volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[542d7ddd-27ec-4b97-936b-6f7a55ddf8af]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:50 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 Jul 03 13:59:50 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:50 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 1G" returned: 0 in 0.770s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:50 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 Jul 03 13:59:50 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:50 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07" returned: 0 in 0.788s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41c49ff2-92c0-4ad7-a487-52290380c5a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a201a7f2-6281-470c-8feb-0944ffc14edb]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:50 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1" returned: 0 in 0.686s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:50 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 is being set with open permissions: ugo+rw Jul 03 13:59:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:50 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 Jul 03 13:59:50 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:51 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 Jul 03 13:59:51 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:51 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1" returned: 0 in 0.631s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:51 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.info Jul 03 13:59:51 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:51 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0" returned: 0 in 0.735s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:51 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 Jul 03 13:59:51 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:52 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.info" returned: 0 in 0.647s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:52 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.info is being set with open permissions: ugo+rw Jul 03 13:59:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:52 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.info Jul 03 13:59:52 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:52 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07" returned: 0 in 0.693s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:52 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07 Jul 03 13:59:52 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:52 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.info" returned: 0 in 0.643s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.241s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:52 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1d523277-cb8f-4a24-9f68-7e8781ca2428 tempest-VolumesSnapshotTestJSON-1270815957 None] Create snapshot completed successfully Jul 03 13:59:52 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0.c707f185-1c97-469b-805e-cb0fbbbc1c07" returned: 0 in 0.670s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-c707f185-1c97-469b-805e-cb0fbbbc1c07" released by "_delete_snapshot" :: held 2.972s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-41c49ff2-92c0-4ad7-a487-52290380c5a0" released by "delete_snapshot" :: held 2.996s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Created reservations ['cea5882f-044f-40e8-af47-d3374d0ddc89', 'a8a727dd-5f8b-48a1-80b0-3b819f9bd3fe', '4e8a20b4-5846-4376-b7cc-c52d08a16060', '0e39ff97-55dd-4bfe-aded-7b7767f8af19'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:53 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Delete snapshot completed successfully. Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-c707f185-1c97-469b-805e-cb0fbbbc1c07-delete_snapshot" released by "delete_snapshot" :: held 3.174s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Snapshots deleted, issuing volume delete {{(pid=86729) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-quobyte-41c49ff2-92c0-4ad7-a487-52290380c5a0" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-41c49ff2-92c0-4ad7-a487-52290380c5a0" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69369ad-591e-4ff2-827b-692a6664dc9b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Flow 'volume_create_manager' (f04ae520-fbf5-468a-bc2f-27aa3026108b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20b7b93-2123-419f-9d5f-e5ac36d80ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:53 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 Jul 03 13:59:53 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20b7b93-2123-419f-9d5f-e5ac36d80ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1702617842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d37553-4ebd-409f-bce3-69780dcc06ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58eaba28865940ea8135c0ae90c80b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:53Z,use_quota=True,user_id='72d2945659ed434da3612b7c51afdb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ea6097-b825-430e-9ccb-4ab5f87fd234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ea6097-b825-430e-9ccb-4ab5f87fd234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d82f818-d491-4bf1-bc21-9e61221da301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d82f818-d491-4bf1-bc21-9e61221da301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d37553-4ebd-409f-bce3-69780dcc06ed', 'volume_name': 'volume-13d37553-4ebd-409f-bce3-69780dcc06ed', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd221af-784d-4b8c-a3f9-e6c0a8550a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd221af-784d-4b8c-a3f9-e6c0a8550a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5585c46e-1275-4917-9ac2-60f1ed456d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:53 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Volume 13d37553-4ebd-409f-bce3-69780dcc06ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d37553-4ebd-409f-bce3-69780dcc06ed', 'volume_size': 1} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1702617842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d37553-4ebd-409f-bce3-69780dcc06ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58eaba28865940ea8135c0ae90c80b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:53Z,use_quota=True,user_id='72d2945659ed434da3612b7c51afdb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Creating volume 13d37553-4ebd-409f-bce3-69780dcc06ed {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:53 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 13:59:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:53 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed 1073741824 Jul 03 13:59:53 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:54 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0" returned: 0 in 0.790s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:54 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0 Jul 03 13:59:54 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:54 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed 1073741824" returned: 0 in 0.867s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:54 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed Jul 03 13:59:54 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Flow 'volume_create_manager' (7e93fa71-4c9f-4ee8-b4eb-6e508181b554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf439a6-8c47-4b9e-80db-f46ab24981e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf439a6-8c47-4b9e-80db-f46ab24981e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T11:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-922974949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2a9c0b-045c-43e8-b928-72a8b67c46c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f23138e147d420c9697e12cbcb21bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9fdd441-0249-40ea-96e4-b39a12b91de1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:59:55Z,use_quota=True,user_id='87066df84dee471dbea14acf854e5f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ea34ad-3e03-40d0-ae4b-f0d293b35562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ea34ad-3e03-40d0-ae4b-f0d293b35562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e642a29c-fa9c-479c-8fa1-5a1e182976e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e642a29c-fa9c-479c-8fa1-5a1e182976e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc2a9c0b-045c-43e8-b928-72a8b67c46c9', 'volume_name': 'volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9', 'volume_size': 1, 'snapshot_id': 'a9fdd441-0249-40ea-96e4-b39a12b91de1'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaddbf92-c127-4ec4-bec3-3259e5ce5efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaddbf92-c127-4ec4-bec3-3259e5ce5efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250f2ed0-7bf6-4fe5-bcff-f1d76116d042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:54 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Volume dc2a9c0b-045c-43e8-b928-72a8b67c46c9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9', 'volume_size': 1, 'snapshot_id': 'a9fdd441-0249-40ea-96e4-b39a12b91de1'} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:54 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-41c49ff2-92c0-4ad7-a487-52290380c5a0" returned: 0 in 0.721s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-41c49ff2-92c0-4ad7-a487-52290380c5a0" released by "delete_volume" :: held 1.568s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Created reservations ['59ccf384-bd5c-401c-90ac-8d9c43a72ff6', 'a50c1457-a9d7-40b1-a1f1-163baa77f800', 'aa0cc481-5693-4889-b136-8b518648667c', 'f766f588-99ee-4907-9494-5f5cd5c0e3a6'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:54 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:59:54 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:55 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed" returned: 0 in 0.726s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.335s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-a9fdd441-0249-40ea-96e4-b39a12b91de1-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" by "_create_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5585c46e-1275-4917-9ac2-60f1ed456d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d37553-4ebd-409f-bce3-69780dcc06ed', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cfeb32b-9924-4b73-b27d-d63342fabd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-a9fdd441-0249-40ea-96e4-b39a12b91de1-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Creating volume dc2a9c0b-045c-43e8-b928-72a8b67c46c9 from snapshot a9fdd441-0249-40ea-96e4-b39a12b91de1 {{(pid=86729) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" by "_copy_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:55 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Volume volume-13d37553-4ebd-409f-bce3-69780dcc06ed (13d37553-4ebd-409f-bce3-69780dcc06ed): created successfully Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cfeb32b-9924-4b73-b27d-d63342fabd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Flow 'volume_create_manager' (f04ae520-fbf5-468a-bc2f-27aa3026108b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] snapshot: a9fdd441-0249-40ea-96e4-b39a12b91de1, volume: dc2a9c0b-045c-43e8-b928-72a8b67c46c9, {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:55 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-267e8cae-f6aa-486b-bafc-e7e156cce304 tempest-AttachVolumeNegativeTest-1456526646 None] Created volume successfully. Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1963c891-595c-4135-af79-b26bfb3c25f3]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:55 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 Jul 03 13:59:55 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-5c230a39-d9c1-4a43-9582-507c2135e440-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-5c230a39-d9c1-4a43-9582-507c2135e440-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "cinder-quobyte-5c230a39-d9c1-4a43-9582-507c2135e440" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 13:59:55 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.780s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-5c230a39-d9c1-4a43-9582-507c2135e440" acquired by "delete_volume" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 13:59:55 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Deleted volume successfully. Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4e3ae471-0298-45d7-b2c4-bdf9ddcb1f95 tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-41c49ff2-92c0-4ad7-a487-52290380c5a0-delete_volume" released by "delete_volume" :: held 5.767s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7fc79e-e86e-49fb-a568-a16eca934a68]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:55 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440 Jul 03 13:59:55 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:56 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1" returned: 0 in 0.834s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 13:59:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] will copy from snapshot at /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 13:59:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Creating direct copy from snapshot {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 13:59:56 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[875df92f-287e-46e2-8c51-596a17dc536b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 13:59:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:56 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 Jul 03 13:59:56 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:56 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440" returned: 0 in 0.755s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:56 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440 Jul 03 13:59:56 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:56 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" returned: 0 in 0.803s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:56 devstack cinder-volume[86729]: DEBUG cinder.utils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Path /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9 not found in is_blk_device check {{(pid=86729) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 13:59:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:56 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9 Jul 03 13:59:56 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:57 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5c230a39-d9c1-4a43-9582-507c2135e440" returned: 0 in 0.625s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-quobyte-5c230a39-d9c1-4a43-9582-507c2135e440" released by "delete_volume" :: held 1.443s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:57 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=90,cinder:DELETE=9,cinder:UPDATE=94,cinder:INSERT=19 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 13:59:57 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Created reservations ['02cd01c0-b3b5-40d0-8b3b-3302097d0f9d', 'b580a572-7ce9-4dde-a5ac-c638b2b9cb93', '22522a55-271f-400c-ba46-1106d6302bd2', '4f35667f-f30c-4214-9476-52a74e2886af'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 13:59:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 13:59:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 13:59:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 13:59:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 13:59:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 13:59:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 13:59:57 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 13:59:57 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 13:59:58 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 03 13:59:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.030s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 13:59:58 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 13:59:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Deleted volume successfully. Jul 03 13:59:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7076616b-1e87-4d1b-b105-49473d3285de tempest-VolumesDeleteCascade-924145307 None] Lock "cinder-5c230a39-d9c1-4a43-9582-507c2135e440-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 13:59:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-55030e40-9e4b-4c03-91ed-19d77ff146a1 req-7694b70c-a217-4a0e-98f7-13d9e5f48381 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" returned: 0 in 5.520s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:02 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f83314-526d-4c69-8447-3858320cdba4]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:02 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 Jul 03 14:00:02 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:03 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" returned: 0 in 0.924s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:00:03 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Converted 1024.00 MB image at 185.46 MB/s Jul 03 14:00:03 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9 is being set with open permissions: ugo+rw Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:03 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9 Jul 03 14:00:03 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Flow 'volume_create_manager' (5e4861c9-c781-44a3-bdb0-732b7d881d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8dc7ab-f08c-427c-9658-536b8482463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8dc7ab-f08c-427c-9658-536b8482463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-217809959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aba1933-cda6-421b-a043-b954336afbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b7b61eeb5b34e5885523f54816bb408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:03Z,use_quota=True,user_id='fdb27a17a1b54333adb1d4a2ff4fdae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0d28b5-449a-49ff-84d6-3b051c2bbd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0d28b5-449a-49ff-84d6-3b051c2bbd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a08d9a-aa8f-48fa-ae0b-992e2a79e3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a08d9a-aa8f-48fa-ae0b-992e2a79e3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aba1933-cda6-421b-a043-b954336afbe8', 'volume_name': 'volume-0aba1933-cda6-421b-a043-b954336afbe8', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74c5705-9e1d-4e4e-96f6-b5746dce8f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74c5705-9e1d-4e4e-96f6-b5746dce8f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8662b08a-e373-4253-9f70-17edf1ddb9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:03 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Volume 0aba1933-cda6-421b-a043-b954336afbe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aba1933-cda6-421b-a043-b954336afbe8', 'volume_size': 1} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:03 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" returned: 0 in 0.653s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" released by "_copy_volume_from_snapshot" :: held 8.838s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-a9fdd441-0249-40ea-96e4-b39a12b91de1-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" released by "_create_volume_from_snapshot" :: held 8.884s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.921s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-55030e40-9e4b-4c03-91ed-19d77ff146a1 req-7694b70c-a217-4a0e-98f7-13d9e5f48381 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.407s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0ccdd3-f001-426f-ad01-6c9eac69711a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-55030e40-9e4b-4c03-91ed-19d77ff146a1 req-7694b70c-a217-4a0e-98f7-13d9e5f48381 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250f2ed0-7bf6-4fe5-bcff-f1d76116d042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9', 'volume_size': 1, 'snapshot_id': 'a9fdd441-0249-40ea-96e4-b39a12b91de1'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18f2c6a-e84c-4051-b875-1b9a6e2c037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:04 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Volume volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9 (dc2a9c0b-045c-43e8-b928-72a8b67c46c9): created successfully Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18f2c6a-e84c-4051-b875-1b9a6e2c037d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Flow 'volume_create_manager' (7e93fa71-4c9f-4ee8-b4eb-6e508181b554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-905f0483-a68e-4fc9-b7a7-0aff842e73c0 tempest-VolumesSnapshotTestJSON-1270815957 None] Created volume successfully. Jul 03 14:00:04 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed Jul 03 14:00:04 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-dc2a9c0b-045c-43e8-b928-72a8b67c46c9-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-dc2a9c0b-045c-43e8-b928-72a8b67c46c9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" acquired by "delete_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:04 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-55030e40-9e4b-4c03-91ed-19d77ff146a1 req-7694b70c-a217-4a0e-98f7-13d9e5f48381 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed" returned: 0 in 0.779s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-55030e40-9e4b-4c03-91ed-19d77ff146a1 req-7694b70c-a217-4a0e-98f7-13d9e5f48381 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.795s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[51715761-409b-41bd-b85a-58db3eb10088]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-217809959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aba1933-cda6-421b-a043-b954336afbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b7b61eeb5b34e5885523f54816bb408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:03Z,use_quota=True,user_id='fdb27a17a1b54333adb1d4a2ff4fdae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Creating volume 0aba1933-cda6-421b-a043-b954336afbe8 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:04 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:04 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 1073741824 Jul 03 14:00:04 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-55030e40-9e4b-4c03-91ed-19d77ff146a1 req-7694b70c-a217-4a0e-98f7-13d9e5f48381 tempest-AttachVolumeNegativeTest-1456526646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-13d37553-4ebd-409f-bce3-69780dcc06ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61f5cbd3-2c50-46f8-b1d2-b0798c3c7d58', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:00:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-55030e40-9e4b-4c03-91ed-19d77ff146a1 req-7694b70c-a217-4a0e-98f7-13d9e5f48381 tempest-AttachVolumeNegativeTest-1456526646 None] attachment_update completed successfully. Jul 03 14:00:04 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9 Jul 03 14:00:04 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:05 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" returned: 0 in 0.790s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:05 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9 Jul 03 14:00:05 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:05 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 1073741824" returned: 0 in 0.893s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:05 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 Jul 03 14:00:05 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:06 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" returned: 0 in 0.678s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-dc2a9c0b-045c-43e8-b928-72a8b67c46c9" released by "delete_volume" :: held 1.530s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Created reservations ['ad2bdbc9-f666-4557-999d-feb4e53a7e25', 'a81aef23-05ac-4dbb-9cd1-7e0dcc902f41', '5da2b050-f4a2-4cf6-a73c-a1b78e0a7b54', 'eeb9356c-85a9-400f-a445-2cf1665d5f78'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:06 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8" returned: 0 in 0.674s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8662b08a-e373-4253-9f70-17edf1ddb9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aba1933-cda6-421b-a043-b954336afbe8', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d558d5-af03-491f-ba03-adcb89321c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:06 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Volume volume-0aba1933-cda6-421b-a043-b954336afbe8 (0aba1933-cda6-421b-a043-b954336afbe8): created successfully Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d558d5-af03-491f-ba03-adcb89321c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:06 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Flow 'volume_create_manager' (5e4861c9-c781-44a3-bdb0-732b7d881d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:06 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:06 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-2ccb56bf-012a-4995-b278-d02c93d7534b tempest-VolumesSnapshotListTestJSON-1058117124 None] Created volume successfully. Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] Creating offline snapshot 34c67047-a4ce-4454-be9a-d677890c3866 of volume 0aba1933-cda6-421b-a043-b954336afbe8 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f87a0e-3b4e-4995-aa4c-a88f9d11c7a2]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-a9fdd441-0249-40ea-96e4-b39a12b91de1-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-a9fdd441-0249-40ea-96e4-b39a12b91de1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-a9fdd441-0249-40ea-96e4-b39a12b91de1" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-a9fdd441-0249-40ea-96e4-b39a12b91de1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Deleting offline snapshot a9fdd441-0249-40ea-96e4-b39a12b91de1 of volume 0506b7e2-4ea0-46c1-9b7b-bf812da99a37 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] snapshot_file for this snap is: volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[df79807d-0873-4b16-8484-5bf12e5e03d2]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:07 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 Jul 03 14:00:07 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:07 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.737s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:07 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Deleted volume successfully. Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bf0cacca-22e7-40c6-83ed-e7815dd48218 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-dc2a9c0b-045c-43e8-b928-72a8b67c46c9-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:07 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 Jul 03 14:00:07 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:07 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8" returned: 0 in 0.822s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:07 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 1G Jul 03 14:00:07 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:07 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1" returned: 0 in 0.802s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f42903-06d3-455d-b0e7-e029a8776340]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:08 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 Jul 03 14:00:08 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:08 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 1G" returned: 0 in 0.809s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aba1933-cda6-421b-a043-b954336afbe8 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:08 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aba1933-cda6-421b-a043-b954336afbe8 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 Jul 03 14:00:08 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:08 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" returned: 0 in 0.747s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:08 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 Jul 03 14:00:08 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:09 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aba1933-cda6-421b-a043-b954336afbe8 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866" returned: 0 in 0.759s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:09 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 is being set with open permissions: ugo+rw Jul 03 14:00:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:09 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 Jul 03 14:00:09 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:09 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1" returned: 0 in 0.812s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:09 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1 Jul 03 14:00:09 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:10 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866" returned: 0 in 0.670s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:10 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.info Jul 03 14:00:10 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:10 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37.a9fdd441-0249-40ea-96e4-b39a12b91de1" returned: 0 in 0.676s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-a9fdd441-0249-40ea-96e4-b39a12b91de1" released by "_delete_snapshot" :: held 3.152s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" released by "delete_snapshot" :: held 3.178s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:10 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Created reservations ['a5138359-5f55-47a6-98a0-46274e8b0ec2', '2faf4d67-778a-4d36-b0ba-665c12d4d809', 'b27be60b-9783-496e-91f7-d281b77de888', '9153d23b-83f6-4c20-a5b8-7f75e4af71fa'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:10 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Delete snapshot completed successfully. Jul 03 14:00:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a24a195d-3812-452b-893b-15f537411d33 tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-a9fdd441-0249-40ea-96e4-b39a12b91de1-delete_snapshot" released by "delete_snapshot" :: held 3.337s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:10 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-a8c6d870-89d9-4f54-afa7-1adddf85d597 req-2fe65f84-ad39-4e95-8bcd-a37aaed7228f tempest-AttachVolumeNegativeTest-1456526646 None] Terminate volume connection completed successfully. Jul 03 14:00:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-a8c6d870-89d9-4f54-afa7-1adddf85d597 req-2fe65f84-ad39-4e95-8bcd-a37aaed7228f tempest-AttachVolumeNegativeTest-1456526646 None] Deleting attachment 61f5cbd3-2c50-46f8-b1d2-b0798c3c7d58. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:00:10 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.info" returned: 0 in 0.729s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:10 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.info is being set with open permissions: ugo+rw Jul 03 14:00:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:10 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.info Jul 03 14:00:10 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-0506b7e2-4ea0-46c1-9b7b-bf812da99a37-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-0506b7e2-4ea0-46c1-9b7b-bf812da99a37-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:11 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbce7c1-b031-4c55-b1d7-0c26fb8a3246]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:11 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.info" returned: 0 in 0.658s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.548s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:11 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9bbb68c0-4fe5-436d-a584-74e63ff0127c tempest-VolumesSnapshotListTestJSON-1058117124 None] Create snapshot completed successfully Jul 03 14:00:11 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 Jul 03 14:00:11 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:12 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" returned: 0 in 0.753s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:12 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37 Jul 03 14:00:12 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] Creating offline snapshot 23041319-a1b5-4c24-b566-ed431eb27687 of volume 0aba1933-cda6-421b-a043-b954336afbe8 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:00:12 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a559d3-8389-4383-8769-a84dd1ed6489]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:12 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 Jul 03 14:00:12 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:12 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" returned: 0 in 0.689s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-0506b7e2-4ea0-46c1-9b7b-bf812da99a37" released by "delete_volume" :: held 1.507s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:12 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Created reservations ['fd7bdaf3-c02b-4a65-be48-b736bfc5f44c', 'cd1530f7-bf38-472b-9c56-ed51524477a2', '1fd7e394-e473-46eb-967b-ded3e61b1329', '7c49d883-b1c2-44fb-89c4-f09a6632be58'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:13 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:00:13 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:13 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866" returned: 0 in 0.828s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aba1933-cda6-421b-a043-b954336afbe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:13 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 1G Jul 03 14:00:13 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-7e7f989b-010d-4f21-90b2-369e50437bc1-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-7e7f989b-010d-4f21-90b2-369e50437bc1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "cinder-quobyte-7e7f989b-010d-4f21-90b2-369e50437bc1" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-7e7f989b-010d-4f21-90b2-369e50437bc1" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:13 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.732s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Deleted volume successfully. Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[2601d1b0-aff1-47e1-8873-0bcc770c397c]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a08fc39e-79f7-4edb-85b9-268e33a6a32a tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-0506b7e2-4ea0-46c1-9b7b-bf812da99a37-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:13 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 Jul 03 14:00:13 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:14 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 1G" returned: 0 in 1.080s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:14 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 Jul 03 14:00:14 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:14 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1" returned: 0 in 0.992s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:14 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1 Jul 03 14:00:14 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:15 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687" returned: 0 in 0.767s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:15 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 is being set with open permissions: ugo+rw Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:15 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 Jul 03 14:00:15 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:15 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-7e7f989b-010d-4f21-90b2-369e50437bc1" returned: 0 in 0.696s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-quobyte-7e7f989b-010d-4f21-90b2-369e50437bc1" released by "delete_volume" :: held 1.759s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Created reservations ['16cd6e82-126e-4dd7-8ac5-8c37918ce505', 'a695a80d-066e-4500-9762-21330b3b8851', 'a2cbf4ef-7ccf-492f-9617-30173eac3980', '0ec79d60-6a6e-443b-9c36-3ad3345cb6fd'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:15 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:00:15 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:15 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687" returned: 0 in 0.761s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.552s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:15 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b9d6717a-9390-42c0-80e1-921ffd5ed06e tempest-VolumesSnapshotListTestJSON-1058117124 None] Create snapshot completed successfully Jul 03 14:00:16 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.757s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:16 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:16 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Deleted volume successfully. Jul 03 14:00:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-39d630dc-4b73-4029-b0dc-29e2c848abba tempest-VolumesSnapshotTestJSON-1270815957 None] Lock "cinder-7e7f989b-010d-4f21-90b2-369e50437bc1-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] Creating offline snapshot 48429fca-b654-4cd9-ab7c-ee61d8920f65 of volume 0aba1933-cda6-421b-a043-b954336afbe8 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:00:16 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c537e1-0ee6-427c-969e-2731e0438df3]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:17 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 Jul 03 14:00:17 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:17 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687" returned: 0 in 0.784s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aba1933-cda6-421b-a043-b954336afbe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:00:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:17 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 1G Jul 03 14:00:17 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:18 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 1G" returned: 0 in 0.910s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:18 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 Jul 03 14:00:18 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:19 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65" returned: 0 in 0.771s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:19 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 is being set with open permissions: ugo+rw Jul 03 14:00:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:19 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 Jul 03 14:00:19 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:20 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65" returned: 0 in 0.671s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.252s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:20 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a3e5fe0d-f9bc-4cac-870a-79df13a819de tempest-VolumesSnapshotListTestJSON-1058117124 None] Create snapshot completed successfully Jul 03 14:00:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "cinder-48429fca-b654-4cd9-ab7c-ee61d8920f65-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-48429fca-b654-4cd9-ab7c-ee61d8920f65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "cinder-quobyte-0aba1933-cda6-421b-a043-b954336afbe8" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-0aba1933-cda6-421b-a043-b954336afbe8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "cinder-quobyte-48429fca-b654-4cd9-ab7c-ee61d8920f65" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-48429fca-b654-4cd9-ab7c-ee61d8920f65" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Deleting offline snapshot 48429fca-b654-4cd9-ab7c-ee61d8920f65 of volume 0aba1933-cda6-421b-a043-b954336afbe8 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:00:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] snapshot_file for this snap is: volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:00:22 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21cc2d0-b4f4-409c-91f0-8b8d07ec023f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:22 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 Jul 03 14:00:22 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:23 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65" returned: 0 in 1.031s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aba1933-cda6-421b-a043-b954336afbe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:00:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d2f46d-3099-48c6-9e52-c2ee785544ac]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:23 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 Jul 03 14:00:23 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:24 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687" returned: 0 in 0.817s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aba1933-cda6-421b-a043-b954336afbe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:00:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:24 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 Jul 03 14:00:24 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:25 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65" returned: 0 in 0.986s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:25 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65 Jul 03 14:00:25 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:25 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.48429fca-b654-4cd9-ab7c-ee61d8920f65" returned: 0 in 0.716s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-48429fca-b654-4cd9-ab7c-ee61d8920f65" released by "_delete_snapshot" :: held 3.716s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-0aba1933-cda6-421b-a043-b954336afbe8" released by "delete_snapshot" :: held 3.752s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:25 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=99,cinder:DELETE=6,cinder:SELECT=109,cinder:INSERT=35 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Created reservations ['e6718e7b-99ab-48ce-9b92-408b9be801f2', '98dc82cd-31e5-466f-b4e1-5d0b3d23d4ff', 'e0fb31cb-b9da-42dc-91c4-fa67c6bea140', '8670fb35-8a51-4a0a-94eb-74539c919fff'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:26 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:00:26 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:26 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Delete snapshot completed successfully. Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c1be2ad1-eec9-4555-91d4-297e14681875 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-48429fca-b654-4cd9-ab7c-ee61d8920f65-delete_snapshot" released by "delete_snapshot" :: held 4.012s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "cinder-23041319-a1b5-4c24-b566-ed431eb27687-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-23041319-a1b5-4c24-b566-ed431eb27687-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "cinder-quobyte-0aba1933-cda6-421b-a043-b954336afbe8" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-0aba1933-cda6-421b-a043-b954336afbe8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "cinder-quobyte-23041319-a1b5-4c24-b566-ed431eb27687" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-23041319-a1b5-4c24-b566-ed431eb27687" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Deleting offline snapshot 23041319-a1b5-4c24-b566-ed431eb27687 of volume 0aba1933-cda6-421b-a043-b954336afbe8 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] snapshot_file for this snap is: volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dfc017-9319-433c-9eff-5397406fceca]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:26 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 Jul 03 14:00:26 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:26 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.733s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:27 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687" returned: 0 in 0.937s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aba1933-cda6-421b-a043-b954336afbe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:00:27 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[763ab973-c9ec-4412-adad-aafab654936b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:27 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 Jul 03 14:00:27 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:28 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866" returned: 0 in 0.830s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aba1933-cda6-421b-a043-b954336afbe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:00:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:28 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 Jul 03 14:00:28 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:29 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687" returned: 0 in 0.841s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:29 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687 Jul 03 14:00:29 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:29 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.23041319-a1b5-4c24-b566-ed431eb27687" returned: 0 in 0.829s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-23041319-a1b5-4c24-b566-ed431eb27687" released by "_delete_snapshot" :: held 3.566s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-0aba1933-cda6-421b-a043-b954336afbe8" released by "delete_snapshot" :: held 3.594s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:30 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Created reservations ['e59342e5-b90f-4710-80e1-b5a14c12339e', 'ce2009ed-f28f-42f3-a1e3-be1e776147d4', '31b7a1ba-e54c-4290-9e32-51f95b7b159a', '4ea15905-5143-479d-bc77-5326d6438ba4'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:30 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Delete snapshot completed successfully. Jul 03 14:00:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0bdaa2da-6621-4294-bdd8-ef66ad88cff9 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-23041319-a1b5-4c24-b566-ed431eb27687-delete_snapshot" released by "delete_snapshot" :: held 3.771s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "cinder-34c67047-a4ce-4454-be9a-d677890c3866-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-34c67047-a4ce-4454-be9a-d677890c3866-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "cinder-quobyte-0aba1933-cda6-421b-a043-b954336afbe8" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-0aba1933-cda6-421b-a043-b954336afbe8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "cinder-quobyte-34c67047-a4ce-4454-be9a-d677890c3866" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-34c67047-a4ce-4454-be9a-d677890c3866" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Deleting offline snapshot 34c67047-a4ce-4454-be9a-d677890c3866 of volume 0aba1933-cda6-421b-a043-b954336afbe8 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:00:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] snapshot_file for this snap is: volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:00:30 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fed1f5d-346f-45b2-a201-1077294ba9e5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:30 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 Jul 03 14:00:30 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:31 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866" returned: 0 in 0.972s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aba1933-cda6-421b-a043-b954336afbe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:00:31 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fbf060-a72f-48fd-bcb7-e73dc70200e9]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:31 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 Jul 03 14:00:31 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:32 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8" returned: 0 in 0.979s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:32 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 Jul 03 14:00:32 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:33 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866" returned: 0 in 0.979s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:33 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866 Jul 03 14:00:33 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:34 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8.34c67047-a4ce-4454-be9a-d677890c3866" returned: 0 in 0.684s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-34c67047-a4ce-4454-be9a-d677890c3866" released by "_delete_snapshot" :: held 3.755s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-0aba1933-cda6-421b-a043-b954336afbe8" released by "delete_snapshot" :: held 3.795s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:34 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Created reservations ['b2d718e9-e352-4f66-8232-57bd5b9ddd59', '61375b12-1120-441e-bcfd-a6918cc1208e', 'a7f3dab3-92ea-4b15-ad25-ac0cb15bff5d', 'abba8a88-5596-42e9-9b40-0e82efe5e1b1'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Delete snapshot completed successfully. Jul 03 14:00:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-465a7c68-a592-48ec-8218-f95c4d838fdb tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-34c67047-a4ce-4454-be9a-d677890c3866-delete_snapshot" released by "delete_snapshot" :: held 3.988s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "cinder-0aba1933-cda6-421b-a043-b954336afbe8-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-0aba1933-cda6-421b-a043-b954336afbe8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "cinder-quobyte-0aba1933-cda6-421b-a043-b954336afbe8" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-0aba1933-cda6-421b-a043-b954336afbe8" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:35 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ad557b-5619-40d2-b2bf-0d51ae9ea4cc]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:35 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 Jul 03 14:00:35 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:36 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8" returned: 0 in 0.759s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:36 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8 Jul 03 14:00:36 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:36 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-0aba1933-cda6-421b-a043-b954336afbe8" returned: 0 in 0.729s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-quobyte-0aba1933-cda6-421b-a043-b954336afbe8" released by "delete_volume" :: held 1.551s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:36 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Created reservations ['3dcb4df2-e6fa-439b-b85a-00f431b2e7b8', '7b8bd332-6b4b-4222-ba5d-f801ea915dea', '140ba5f1-ca60-401b-8f02-8d3a87dc7502', 'b52d6ab1-2e82-4205-b1a0-50b5d9519bec'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:00:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:36 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:00:36 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:37 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.742s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:37 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:00:37 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Deleted volume successfully. Jul 03 14:00:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1ed87a08-eb13-4822-ba97-e4f06d9074a3 tempest-VolumesSnapshotListTestJSON-1058117124 None] Lock "cinder-0aba1933-cda6-421b-a043-b954336afbe8-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Flow 'volume_create_manager' (0e4d9621-040c-414e-90a2-f56941c777b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efb7ad6-24ca-438d-bf30-d0bfab6cea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efb7ad6-24ca-438d-bf30-d0bfab6cea90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1871976065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1f0415-3928-42d8-a910-caeccae775af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2d00e2b2148a7b8aaeff9dcd4e11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:42Z,use_quota=True,user_id='7258481fa99f4ba5b80b3755dc8d1a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7e93bb-add8-4c17-903c-6edf64c8c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7e93bb-add8-4c17-903c-6edf64c8c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5788eb0-69ff-401f-b687-f6b587c6fcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5788eb0-69ff-401f-b687-f6b587c6fcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1f0415-3928-42d8-a910-caeccae775af', 'volume_name': 'volume-4a1f0415-3928-42d8-a910-caeccae775af', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5491d027-9b97-4101-b4c1-50867d0948a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5491d027-9b97-4101-b4c1-50867d0948a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432a570a-7ba3-46ce-b622-f5dec26a8b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:42 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume 4a1f0415-3928-42d8-a910-caeccae775af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1f0415-3928-42d8-a910-caeccae775af', 'volume_size': 1} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1871976065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1f0415-3928-42d8-a910-caeccae775af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2d00e2b2148a7b8aaeff9dcd4e11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:42Z,use_quota=True,user_id='7258481fa99f4ba5b80b3755dc8d1a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Creating volume 4a1f0415-3928-42d8-a910-caeccae775af {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:42 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:00:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a1f0415-3928-42d8-a910-caeccae775af 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:42 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a1f0415-3928-42d8-a910-caeccae775af 1073741824 Jul 03 14:00:42 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:43 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a1f0415-3928-42d8-a910-caeccae775af 1073741824" returned: 0 in 1.645s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a1f0415-3928-42d8-a910-caeccae775af {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:44 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a1f0415-3928-42d8-a910-caeccae775af Jul 03 14:00:44 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:45 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a1f0415-3928-42d8-a910-caeccae775af" returned: 0 in 1.388s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] <== create_volume: return (3129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.135s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432a570a-7ba3-46ce-b622-f5dec26a8b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1f0415-3928-42d8-a910-caeccae775af', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182237bf-4dde-4673-b454-04146d48b9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:45 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume volume-4a1f0415-3928-42d8-a910-caeccae775af (4a1f0415-3928-42d8-a910-caeccae775af): created successfully Jul 03 14:00:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182237bf-4dde-4673-b454-04146d48b9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Flow 'volume_create_manager' (0e4d9621-040c-414e-90a2-f56941c777b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:45 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-4480a8ce-771f-4cac-be81-3f8df414c406 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Created volume successfully. Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Flow 'volume_create_manager' (a18e8c23-d77f-4914-a4eb-4f13cd0a1c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749cd1b7-56ea-4f7f-be95-b57c49bc99ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749cd1b7-56ea-4f7f-be95-b57c49bc99ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013780550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b701f52b-879c-4c1b-bf25-56e0b9d3732c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2d00e2b2148a7b8aaeff9dcd4e11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:47Z,use_quota=True,user_id='7258481fa99f4ba5b80b3755dc8d1a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52e6ad0-58ad-4d0f-b84f-f22827e786fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52e6ad0-58ad-4d0f-b84f-f22827e786fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437ef3e5-c1e4-4f8e-aa46-a68f8957aba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437ef3e5-c1e4-4f8e-aa46-a68f8957aba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b701f52b-879c-4c1b-bf25-56e0b9d3732c', 'volume_name': 'volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c1a9a87-0be2-4bb9-a04c-90e64eaf5eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c1a9a87-0be2-4bb9-a04c-90e64eaf5eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03464838-f24c-45af-b027-abbc3913e5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:47 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume b701f52b-879c-4c1b-bf25-56e0b9d3732c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c', 'volume_size': 1} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013780550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b701f52b-879c-4c1b-bf25-56e0b9d3732c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2d00e2b2148a7b8aaeff9dcd4e11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:47Z,use_quota=True,user_id='7258481fa99f4ba5b80b3755dc8d1a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Creating volume b701f52b-879c-4c1b-bf25-56e0b9d3732c {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:47 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:47 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c 1073741824 Jul 03 14:00:47 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Flow 'volume_create_manager' (4f0259db-d6cf-4b94-a17f-62dfb56f524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164e040f-1f7e-42a9-8e4a-3bca0b6d2620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164e040f-1f7e-42a9-8e4a-3bca0b6d2620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087150112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909f8cbd-d1c0-4da3-bce1-701fc6e77dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2d00e2b2148a7b8aaeff9dcd4e11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:48Z,use_quota=True,user_id='7258481fa99f4ba5b80b3755dc8d1a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5318e1fe-3552-42f2-8503-f0e3a98bba57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5318e1fe-3552-42f2-8503-f0e3a98bba57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b676b89-8119-4e13-9a5d-2111c9884e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b676b89-8119-4e13-9a5d-2111c9884e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909f8cbd-d1c0-4da3-bce1-701fc6e77dc1', 'volume_name': 'volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e80055c-5abc-468c-abeb-c27b54137806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e80055c-5abc-468c-abeb-c27b54137806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506eedc6-b6d7-424e-8367-05b71bdf1cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:47 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume 909f8cbd-d1c0-4da3-bce1-701fc6e77dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1', 'volume_size': 1} Jul 03 14:00:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Flow 'volume_create_manager' (b79a53e5-fb3c-4efa-9c54-3743ec1c1e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c611de-f1f5-48b5-aae8-c1d456122c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c611de-f1f5-48b5-aae8-c1d456122c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-682437747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad0563c-d356-48a1-a01f-dca40870e5df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2d00e2b2148a7b8aaeff9dcd4e11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:48Z,use_quota=True,user_id='7258481fa99f4ba5b80b3755dc8d1a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82bcc6a-b257-46c2-a1a4-126ced6e47cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82bcc6a-b257-46c2-a1a4-126ced6e47cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc004a5-bfa4-49d2-9ad9-fe87cfa83a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc004a5-bfa4-49d2-9ad9-fe87cfa83a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad0563c-d356-48a1-a01f-dca40870e5df', 'volume_name': 'volume-4ad0563c-d356-48a1-a01f-dca40870e5df', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4f7bc4-ef53-4d80-b904-d5802a8fdcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4f7bc4-ef53-4d80-b904-d5802a8fdcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde1b28f-95f8-42ca-b807-99a37884117e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:48 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume 4ad0563c-d356-48a1-a01f-dca40870e5df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad0563c-d356-48a1-a01f-dca40870e5df', 'volume_size': 1} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:48 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c 1073741824" returned: 0 in 1.447s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:48 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c Jul 03 14:00:48 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Flow 'volume_create_manager' (c24c5a5d-2183-4df2-8358-9704f05a2d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bbf5fc-d291-4ed9-9eb0-7c43c2c3857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bbf5fc-d291-4ed9-9eb0-7c43c2c3857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1329033814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca36dff3-8e3a-49f2-b60e-a5124177ea71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2d00e2b2148a7b8aaeff9dcd4e11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:49Z,use_quota=True,user_id='7258481fa99f4ba5b80b3755dc8d1a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9df44e-e7df-4667-9935-c1ed7dffd774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9df44e-e7df-4667-9935-c1ed7dffd774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cb048a-8fc9-4278-bc4c-ac121b004b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cb048a-8fc9-4278-bc4c-ac121b004b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca36dff3-8e3a-49f2-b60e-a5124177ea71', 'volume_name': 'volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6df30b-8123-48d4-be78-84885c4d0e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6df30b-8123-48d4-be78-84885c4d0e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bc4959-5b97-4115-8d70-c5ccaa33a27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:49 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume ca36dff3-8e3a-49f2-b60e-a5124177ea71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71', 'volume_size': 1} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Flow 'volume_create_manager' (1fe9ed51-6d2c-4faa-82c5-0f5c0827a69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc12622-a67f-4dc8-ad37-e4dbe6a2ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc12622-a67f-4dc8-ad37-e4dbe6a2ab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-955124878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c850bd49-7dd5-44b0-b5b0-8eee551ca6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16cbf713c2b4a649e34b32206baae3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:49Z,use_quota=True,user_id='1c292c2633cb4f15addaa2827931a7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70fe0276-426c-422f-b6a0-a77b762bafed),volume_type_id=70fe0276-426c-422f-b6a0-a77b762bafed)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635be6da-42a3-48eb-9725-5f091c581527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635be6da-42a3-48eb-9725-5f091c581527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2203156d-3fbc-4888-8085-075015bec290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2203156d-3fbc-4888-8085-075015bec290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c850bd49-7dd5-44b0-b5b0-8eee551ca6cd', 'volume_name': 'volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8a007c-d890-4907-b196-e949f933998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8a007c-d890-4907-b196-e949f933998d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c812032e-66b4-4660-8a5c-58dd7545c241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:49 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Volume c850bd49-7dd5-44b0-b5b0-8eee551ca6cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd', 'volume_size': 1} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:49 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c" returned: 0 in 0.975s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] <== create_volume: return (2476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.481s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.847s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087150112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909f8cbd-d1c0-4da3-bce1-701fc6e77dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2d00e2b2148a7b8aaeff9dcd4e11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:48Z,use_quota=True,user_id='7258481fa99f4ba5b80b3755dc8d1a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Creating volume 909f8cbd-d1c0-4da3-bce1-701fc6e77dc1 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:49 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03464838-f24c-45af-b027-abbc3913e5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f18b35b-bab5-4061-89e1-cddebd0dc8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:49 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1 1073741824 Jul 03 14:00:49 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:49 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c (b701f52b-879c-4c1b-bf25-56e0b9d3732c): created successfully Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f18b35b-bab5-4061-89e1-cddebd0dc8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:49 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Flow 'volume_create_manager' (a18e8c23-d77f-4914-a4eb-4f13cd0a1c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:49 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6ba07791-7642-4d80-8e0b-c1e7d978a207 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Created volume successfully. Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Flow 'volume_create_manager' (dc6020b4-a6b4-4d8a-82d6-4d835ba66da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda5bb42-2f81-47a9-ab8f-f5f9eb2f3ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda5bb42-2f81-47a9-ab8f-f5f9eb2f3ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306743421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ba227d-9651-4091-a4eb-b0dffa25f96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2d00e2b2148a7b8aaeff9dcd4e11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:50Z,use_quota=True,user_id='7258481fa99f4ba5b80b3755dc8d1a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19a5a00-672c-4bcd-aa4e-d2025c55bce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19a5a00-672c-4bcd-aa4e-d2025c55bce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5d1df7-b27e-4c4a-be30-30d28f4cd19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5d1df7-b27e-4c4a-be30-30d28f4cd19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ba227d-9651-4091-a4eb-b0dffa25f96f', 'volume_name': 'volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e44736-c5b0-462c-af04-4d9432c0fbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e44736-c5b0-462c-af04-4d9432c0fbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b9cf45-00c5-46c4-ab4b-425c93c4e6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume c7ba227d-9651-4091-a4eb-b0dffa25f96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f', 'volume_size': 1} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Flow 'volume_create_manager' (ec44da99-e457-4b0e-89cf-264d4f096ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cdf360-1068-4afa-8e0d-72a1b10cf19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cdf360-1068-4afa-8e0d-72a1b10cf19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1199974312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022d759e-32a0-460e-8239-3b7e50037c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16cbf713c2b4a649e34b32206baae3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:50Z,use_quota=True,user_id='1c292c2633cb4f15addaa2827931a7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3f29fc-ef93-4c53-934f-b14109686ea4),volume_type_id=7e3f29fc-ef93-4c53-934f-b14109686ea4)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c5781a-4dd3-4312-8c76-5b7fbc228c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c5781a-4dd3-4312-8c76-5b7fbc228c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ec3f87-5231-4c6f-a322-33c6d9e4532b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ec3f87-5231-4c6f-a322-33c6d9e4532b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022d759e-32a0-460e-8239-3b7e50037c59', 'volume_name': 'volume-022d759e-32a0-460e-8239-3b7e50037c59', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0d47a9-e540-48be-bd3e-f8234e4bd402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0d47a9-e540-48be-bd3e-f8234e4bd402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1b4ac5-06c1-4793-a433-47fcc48931d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Volume 022d759e-32a0-460e-8239-3b7e50037c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022d759e-32a0-460e-8239-3b7e50037c59', 'volume_size': 1} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:00:50 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Flow 'volume_create_manager' (83eb5dc6-fdfb-4641-a7a4-bd3db3aa1a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1b57d8-a9c0-429a-b033-731d6837c7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1 1073741824" returned: 0 in 1.137s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1b57d8-a9c0-429a-b033-731d6837c7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-514476579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db4ece4-c772-43aa-a15e-37062480e475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16cbf713c2b4a649e34b32206baae3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:51Z,use_quota=True,user_id='1c292c2633cb4f15addaa2827931a7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f912360-30e8-4157-a193-5d49e60db517),volume_type_id=4f912360-30e8-4157-a193-5d49e60db517)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f05948a-7083-4859-aa55-f912d347a1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f05948a-7083-4859-aa55-f912d347a1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfd1b0a-d13b-47c2-a11f-80a285f2862b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.image.glance [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Creating Keystone auth plugin from conf {{(pid=86729) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:51 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1 Jul 03 14:00:51 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfd1b0a-d13b-47c2-a11f-80a285f2862b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1db4ece4-c772-43aa-a15e-37062480e475', 'volume_name': 'volume-1db4ece4-c772-43aa-a15e-37062480e475', 'volume_size': 1, 'image_id': '03b34a00-24d0-41c0-bb11-40c718f72a52', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03b34a00-24d0-41c0-bb11-40c718f72a52', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1920008248', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16cbf713c2b4a649e34b32206baae3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '03b34a00-24d0-41c0-bb11-40c718f72a52', 'created_at': datetime.datetime(2026, 7, 3, 12, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 0, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03b34a00-24d0-41c0-bb11-40c718f72a52/file', 'properties': {}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db77a16c-77ea-4486-939d-19e0abffcdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db77a16c-77ea-4486-939d-19e0abffcdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90729d8-c5c0-409f-b175-ca2523ccbc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:51 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Volume 1db4ece4-c772-43aa-a15e-37062480e475: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1db4ece4-c772-43aa-a15e-37062480e475', 'volume_size': 1, 'image_id': '03b34a00-24d0-41c0-bb11-40c718f72a52', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03b34a00-24d0-41c0-bb11-40c718f72a52', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1920008248', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16cbf713c2b4a649e34b32206baae3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '03b34a00-24d0-41c0-bb11-40c718f72a52', 'created_at': datetime.datetime(2026, 7, 3, 12, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 0, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03b34a00-24d0-41c0-bb11-40c718f72a52/file', 'properties': {}}, 'image_service': } Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Trying to clone 1db4ece4-c772-43aa-a15e-37062480e475 from image 03b34a00-24d0-41c0-bb11-40c718f72a52 at location (None, [{'url': 'file:///opt/stack/data/glance/images/03b34a00-24d0-41c0-bb11-40c718f72a52', 'metadata': {}}]). {{(pid=86729) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:00:51 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1" returned: 0 in 0.853s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.343s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-682437747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad0563c-d356-48a1-a01f-dca40870e5df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2d00e2b2148a7b8aaeff9dcd4e11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:48Z,use_quota=True,user_id='7258481fa99f4ba5b80b3755dc8d1a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Creating volume 4ad0563c-d356-48a1-a01f-dca40870e5df {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:51 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4ad0563c-d356-48a1-a01f-dca40870e5df 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:51 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4ad0563c-d356-48a1-a01f-dca40870e5df 1073741824 Jul 03 14:00:51 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506eedc6-b6d7-424e-8367-05b71bdf1cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51454545-2848-4c9f-ab07-91185226c694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:51 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1 (909f8cbd-d1c0-4da3-bce1-701fc6e77dc1): created successfully Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51454545-2848-4c9f-ab07-91185226c694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Flow 'volume_create_manager' (4f0259db-d6cf-4b94-a17f-62dfb56f524d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:51 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-efcf37d4-b94e-4dc3-9926-e34c20bf0f59 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Created volume successfully. Jul 03 14:00:52 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4ad0563c-d356-48a1-a01f-dca40870e5df 1073741824" returned: 0 in 0.881s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4ad0563c-d356-48a1-a01f-dca40870e5df {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:52 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4ad0563c-d356-48a1-a01f-dca40870e5df Jul 03 14:00:52 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:53 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4ad0563c-d356-48a1-a01f-dca40870e5df" returned: 0 in 0.706s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.138s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1329033814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca36dff3-8e3a-49f2-b60e-a5124177ea71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2d00e2b2148a7b8aaeff9dcd4e11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:49Z,use_quota=True,user_id='7258481fa99f4ba5b80b3755dc8d1a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Creating volume ca36dff3-8e3a-49f2-b60e-a5124177ea71 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:53 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:53 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71 1073741824 Jul 03 14:00:53 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde1b28f-95f8-42ca-b807-99a37884117e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad0563c-d356-48a1-a01f-dca40870e5df', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8253f94c-5c91-4bb1-aff4-fea2c1e9dfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:53 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume volume-4ad0563c-d356-48a1-a01f-dca40870e5df (4ad0563c-d356-48a1-a01f-dca40870e5df): created successfully Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8253f94c-5c91-4bb1-aff4-fea2c1e9dfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Flow 'volume_create_manager' (b79a53e5-fb3c-4efa-9c54-3743ec1c1e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:53 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b1a342ae-c2f3-45a7-80fe-da332baa252b tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Created volume successfully. Jul 03 14:00:54 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71 1073741824" returned: 0 in 0.915s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:54 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71 Jul 03 14:00:54 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:54 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD, size 20.69 MB, duration 3.50 sec {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:00:54 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Image download 20.69 MB at 5.91 MB/s Jul 03 14:00:54 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe665435-cbf9-41b5-a61d-6837bd7641a5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:54 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD Jul 03 14:00:54 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:55 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71" returned: 0 in 0.662s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.507s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-955124878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c850bd49-7dd5-44b0-b5b0-8eee551ca6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16cbf713c2b4a649e34b32206baae3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:49Z,use_quota=True,user_id='1c292c2633cb4f15addaa2827931a7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70fe0276-426c-422f-b6a0-a77b762bafed),volume_type_id=70fe0276-426c-422f-b6a0-a77b762bafed)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Creating volume c850bd49-7dd5-44b0-b5b0-8eee551ca6cd {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:55 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bc4959-5b97-4115-8d70-c5ccaa33a27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:55 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd 1073741824 Jul 03 14:00:55 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31d41de-07da-4a6a-9cce-279e59541f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:55 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71 (ca36dff3-8e3a-49f2-b60e-a5124177ea71): created successfully Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31d41de-07da-4a6a-9cce-279e59541f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Flow 'volume_create_manager' (c24c5a5d-2183-4df2-8358-9704f05a2d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:55 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-2c500f53-3413-4ded-a023-9f80d24fb350 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Created volume successfully. Jul 03 14:00:55 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD" returned: 0 in 0.741s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Temporary image 03b34a00-24d0-41c0-bb11-40c718f72a52 is fetched for user 1c292c2633cb4f15addaa2827931a7bd. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5a0f71-f67b-4925-a7b7-39c512134780]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:55 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD Jul 03 14:00:55 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:56 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd 1073741824" returned: 0 in 0.835s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:56 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd Jul 03 14:00:56 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:56 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD" returned: 0 in 0.772s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:56 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd" returned: 0 in 0.645s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.621s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306743421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ba227d-9651-4091-a4eb-b0dffa25f96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2d00e2b2148a7b8aaeff9dcd4e11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:50Z,use_quota=True,user_id='7258481fa99f4ba5b80b3755dc8d1a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Creating volume c7ba227d-9651-4091-a4eb-b0dffa25f96f {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:56 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:56 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f 1073741824 Jul 03 14:00:56 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c812032e-66b4-4660-8a5c-58dd7545c241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aead73c0-e16c-4f3d-993a-a831e3c41bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:56 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Volume volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd (c850bd49-7dd5-44b0-b5b0-8eee551ca6cd): created successfully Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aead73c0-e16c-4f3d-993a-a831e3c41bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Flow 'volume_create_manager' (1fe9ed51-6d2c-4faa-82c5-0f5c0827a69b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:56 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-8595f70f-f0d9-43a3-b12b-7b0762f830a8 tempest-TestInstancesWithCinderVolumes-1328022136 None] Created volume successfully. Jul 03 14:00:57 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f 1073741824" returned: 0 in 0.789s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:57 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=99,cinder:DELETE=11,cinder:SELECT=66,cinder:INSERT=22 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:00:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:57 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f Jul 03 14:00:57 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:58 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f" returned: 0 in 0.619s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.834s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1199974312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022d759e-32a0-460e-8239-3b7e50037c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16cbf713c2b4a649e34b32206baae3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:50Z,use_quota=True,user_id='1c292c2633cb4f15addaa2827931a7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3f29fc-ef93-4c53-934f-b14109686ea4),volume_type_id=7e3f29fc-ef93-4c53-934f-b14109686ea4)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Creating volume 022d759e-32a0-460e-8239-3b7e50037c59 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:58 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b9cf45-00c5-46c4-ab4b-425c93c4e6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:58 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59 1073741824 Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0772921f-8b66-4b6b-8613-f3c97a8449ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:58 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:58 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Volume volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f (c7ba227d-9651-4091-a4eb-b0dffa25f96f): created successfully Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0772921f-8b66-4b6b-8613-f3c97a8449ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Flow 'volume_create_manager' (dc6020b4-a6b4-4d8a-82d6-4d835ba66da1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-89641937-1d99-4e6a-8c8f-e97ed0bf6258 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Created volume successfully. Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "cinder-c7ba227d-9651-4091-a4eb-b0dffa25f96f-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-c7ba227d-9651-4091-a4eb-b0dffa25f96f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "cinder-quobyte-c7ba227d-9651-4091-a4eb-b0dffa25f96f" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-quobyte-c7ba227d-9651-4091-a4eb-b0dffa25f96f" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0b08c2-73fe-4c6c-a08f-e7ea34fa2540]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:00:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:58 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f Jul 03 14:00:58 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:59 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59 1073741824" returned: 0 in 0.855s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:59 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59 Jul 03 14:00:59 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:59 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f" returned: 0 in 0.773s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:59 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f Jul 03 14:00:59 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:59 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59" returned: 0 in 0.646s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.270s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-514476579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db4ece4-c772-43aa-a15e-37062480e475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16cbf713c2b4a649e34b32206baae3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:00:51Z,use_quota=True,user_id='1c292c2633cb4f15addaa2827931a7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f912360-30e8-4157-a193-5d49e60db517),volume_type_id=4f912360-30e8-4157-a193-5d49e60db517)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Creating volume 1db4ece4-c772-43aa-a15e-37062480e475 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:00:59 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:00:59 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 1073741824 Jul 03 14:00:59 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1b4ac5-06c1-4793-a433-47fcc48931d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022d759e-32a0-460e-8239-3b7e50037c59', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d442d691-0fc4-48ef-afca-669002231ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:00:59 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Volume volume-022d759e-32a0-460e-8239-3b7e50037c59 (022d759e-32a0-460e-8239-3b7e50037c59): created successfully Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d442d691-0fc4-48ef-afca-669002231ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:00:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Flow 'volume_create_manager' (ec44da99-e457-4b0e-89cf-264d4f096ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:00:59 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-5398ac04-4990-41e4-89a2-f5a915d74f7c tempest-TestInstancesWithCinderVolumes-1328022136 None] Created volume successfully. Jul 03 14:01:00 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7ba227d-9651-4091-a4eb-b0dffa25f96f" returned: 0 in 0.696s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-quobyte-c7ba227d-9651-4091-a4eb-b0dffa25f96f" released by "delete_volume" :: held 1.514s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Created reservations ['add697fb-65b8-4b64-9689-a506bee424c4', '19e1ceea-1569-45fc-b3f2-905865814bec', 'bdc680b1-e0a7-4017-a466-311cc398bbb5', '27fd00d5-6db3-4d2f-be2e-c64c5d9681d8'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:00 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:01:00 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:00 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 1073741824" returned: 0 in 0.976s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:00 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 Jul 03 14:01:00 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "cinder-ca36dff3-8e3a-49f2-b60e-a5124177ea71-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-ca36dff3-8e3a-49f2-b60e-a5124177ea71-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "cinder-quobyte-ca36dff3-8e3a-49f2-b60e-a5124177ea71" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-quobyte-ca36dff3-8e3a-49f2-b60e-a5124177ea71" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a63622a-95c0-47e4-be75-8d60b7ddcf7a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:01 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.785s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:01 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Deleted volume successfully. Jul 03 14:01:01 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71 Jul 03 14:01:01 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f5eed582-2487-4c59-9745-ca326803b317 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-c7ba227d-9651-4091-a4eb-b0dffa25f96f-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:01 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475" returned: 0 in 0.761s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Attempting download of 03b34a00-24d0-41c0-bb11-40c718f72a52 ((None, [{'url': 'file:///opt/stack/data/glance/images/03b34a00-24d0-41c0-bb11-40c718f72a52', 'metadata': {}}])) to volume 1db4ece4-c772-43aa-a15e-37062480e475. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5812fb6-4631-406c-a839-a499382b601f]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03b34a00-24d0-41c0-bb11-40c718f72a52_jy9osv7h {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:01 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03b34a00-24d0-41c0-bb11-40c718f72a52_jy9osv7h Jul 03 14:01:01 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:01 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71" returned: 0 in 0.854s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:01 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71 Jul 03 14:01:01 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:02 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03b34a00-24d0-41c0-bb11-40c718f72a52_jy9osv7h" returned: 0 in 0.736s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03b34a00-24d0-41c0-bb11-40c718f72a52_jy9osv7h {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:02 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03b34a00-24d0-41c0-bb11-40c718f72a52_jy9osv7h Jul 03 14:01:02 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:02 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ca36dff3-8e3a-49f2-b60e-a5124177ea71" returned: 0 in 0.667s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-quobyte-ca36dff3-8e3a-49f2-b60e-a5124177ea71" released by "delete_volume" :: held 1.583s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:02 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Created reservations ['bb97ff49-3d4b-4ad5-abb4-e50f02b9b19e', 'f6647b09-3d4b-41fa-8097-b71092e8a2ad', '9124119f-5c04-41de-80cb-cc8ff22b12ff', 'b89a7a85-5880-4a37-b16f-40152c6f94d6'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:02 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:01:02 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "cinder-4ad0563c-d356-48a1-a01f-dca40870e5df-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:03 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03b34a00-24d0-41c0-bb11-40c718f72a52_jy9osv7h" returned: 1 in 0.774s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03b34a00-24d0-41c0-bb11-40c718f72a52_jy9osv7h' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[149a6b8f-58f3-443a-bd1f-de0db5a4cfbe]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-4ad0563c-d356-48a1-a01f-dca40870e5df-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "cinder-quobyte-4ad0563c-d356-48a1-a01f-dca40870e5df" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-quobyte-4ad0563c-d356-48a1-a01f-dca40870e5df" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f9c8ee-5700-417a-8225-1b3af3051f4e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4ad0563c-d356-48a1-a01f-dca40870e5df {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:03 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD Jul 03 14:01:03 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:03 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.649s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:03 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Deleted volume successfully. Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f150f5fd-1391-4e65-963e-baa8c4fe528c tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-ca36dff3-8e3a-49f2-b60e-a5124177ea71-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:03 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4ad0563c-d356-48a1-a01f-dca40870e5df Jul 03 14:01:03 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:03 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD" returned: 0 in 0.728s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] 03b34a00-24d0-41c0-bb11-40c718f72a52 was qcow2, converting to raw {{(pid=86729) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:01:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:03 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 Jul 03 14:01:03 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:04 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4ad0563c-d356-48a1-a01f-dca40870e5df" returned: 0 in 0.766s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4ad0563c-d356-48a1-a01f-dca40870e5df {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:04 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4ad0563c-d356-48a1-a01f-dca40870e5df Jul 03 14:01:04 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:04 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4ad0563c-d356-48a1-a01f-dca40870e5df" returned: 0 in 0.636s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-quobyte-4ad0563c-d356-48a1-a01f-dca40870e5df" released by "delete_volume" :: held 1.452s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:04 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Created reservations ['6fc7c93a-d227-48c3-a9c5-b269fd6ddf6c', 'e2f8eed2-0f0f-42cb-b5a8-1086997450dc', 'fc2a0511-b4ba-44d3-afbe-23a9964cdcd5', '37f40b18-e9ee-4b60-a2f7-2ff8914b1217'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:04 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:01:04 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "cinder-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "cinder-quobyte-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-quobyte-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:05 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e872a8-805d-4a3b-949f-a64fb416032e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:05 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.711s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:05 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Deleted volume successfully. Jul 03 14:01:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d4414eee-ee05-4471-8812-964280debdca tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-4ad0563c-d356-48a1-a01f-dca40870e5df-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:05 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1 Jul 03 14:01:05 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:05 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475" returned: 0 in 2.000s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:05 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_03b34a00-24d0-41c0-bb11-40c718f72a52_w8g6hks4devstack@QuobyteHD, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:01:05 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Converted 112.00 MB image at 55.99 MB/s Jul 03 14:01:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:05 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 1G Jul 03 14:01:05 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Flow 'volume_create_manager' (b450d1ac-9dc4-42c6-aa87-bd3e89188945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af75851-ece1-4d83-b249-7fa0dabea54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af75851-ece1-4d83-b249-7fa0dabea54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-830203673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4127aa3d-55d9-4c32-8ec3-5232f005ecf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58eaba28865940ea8135c0ae90c80b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:06Z,use_quota=True,user_id='72d2945659ed434da3612b7c51afdb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a395b4cd-4ab6-46dc-a79f-dc5aacf8f36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a395b4cd-4ab6-46dc-a79f-dc5aacf8f36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9912fc4a-95a2-42b5-9d93-893f9f7fcb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9912fc4a-95a2-42b5-9d93-893f9f7fcb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4127aa3d-55d9-4c32-8ec3-5232f005ecf7', 'volume_name': 'volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa17dd79-ea85-4f80-bbab-acd65d88c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa17dd79-ea85-4f80-bbab-acd65d88c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e6a7a6-b648-466a-9838-fa81684bf00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:06 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Volume 4127aa3d-55d9-4c32-8ec3-5232f005ecf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7', 'volume_size': 1} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-830203673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4127aa3d-55d9-4c32-8ec3-5232f005ecf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58eaba28865940ea8135c0ae90c80b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:06Z,use_quota=True,user_id='72d2945659ed434da3612b7c51afdb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Creating volume 4127aa3d-55d9-4c32-8ec3-5232f005ecf7 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:01:06 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:06 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7 1073741824 Jul 03 14:01:06 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:06 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1" returned: 0 in 0.848s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:06 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1 Jul 03 14:01:06 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:06 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 1G" returned: 0 in 0.733s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[619c0219-ea54-42f6-918a-4b61653edfb9]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:06 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 Jul 03 14:01:06 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:07 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1" returned: 0 in 0.728s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:07 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7 1073741824" returned: 0 in 0.854s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-quobyte-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1" released by "delete_volume" :: held 1.636s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:07 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7 Jul 03 14:01:07 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Created reservations ['e08e368a-efea-4eb6-b3bc-182a8d977113', '109bd7cc-c833-4502-bfbb-67132e271bf7', '8bbb3534-80ae-4ec3-a854-586570c8a9da', '7a52b8f1-c12d-421a-aed2-fd1d5cbbcd31'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:07 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:01:07 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:07 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475" returned: 0 in 0.764s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:07 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 Jul 03 14:01:07 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "cinder-b701f52b-879c-4c1b-bf25-56e0b9d3732c-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-b701f52b-879c-4c1b-bf25-56e0b9d3732c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "cinder-quobyte-b701f52b-879c-4c1b-bf25-56e0b9d3732c" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-quobyte-b701f52b-879c-4c1b-bf25-56e0b9d3732c" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5429d4f8-d57b-4b38-be83-f6d0653e5439]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:07 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7" returned: 0 in 0.802s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e6a7a6-b648-466a-9838-fa81684bf00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7c69d8-9d54-4436-8fcc-2c54009cc203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:07 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c Jul 03 14:01:07 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:07 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Volume volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7 (4127aa3d-55d9-4c32-8ec3-5232f005ecf7): created successfully Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7c69d8-9d54-4436-8fcc-2c54009cc203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Flow 'volume_create_manager' (b450d1ac-9dc4-42c6-aa87-bd3e89188945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:07 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.760s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:07 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:07 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Deleted volume successfully. Jul 03 14:01:07 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-72851e3c-7d0a-43d6-b0d9-92182f003fd1 tempest-AttachVolumeNegativeTest-1456526646 None] Created volume successfully. Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-be02b23e-f739-47f4-a97b-633befce61be tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-909f8cbd-d1c0-4da3-bce1-701fc6e77dc1-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:08 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475" returned: 1 in 0.868s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Downloaded image 03b34a00-24d0-41c0-bb11-40c718f72a52 ((None, [{'url': 'file:///opt/stack/data/glance/images/03b34a00-24d0-41c0-bb11-40c718f72a52', 'metadata': {}}])) to volume 1db4ece4-c772-43aa-a15e-37062480e475 successfully. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Temporary image 03b34a00-24d0-41c0-bb11-40c718f72a52 for user 1c292c2633cb4f15addaa2827931a7bd is deleted. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Marking volume 1db4ece4-c772-43aa-a15e-37062480e475 as bootable. {{(pid=86729) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Copying metadata from image 03b34a00-24d0-41c0-bb11-40c718f72a52 to 1db4ece4-c772-43aa-a15e-37062480e475. {{(pid=86729) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Creating volume glance metadata for volume 1db4ece4-c772-43aa-a15e-37062480e475 backed by image 03b34a00-24d0-41c0-bb11-40c718f72a52 with: {'image_id': '03b34a00-24d0-41c0-bb11-40c718f72a52', 'image_name': 'tempest-scenario-img--1920008248', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86729) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90729d8-c5c0-409f-b175-ca2523ccbc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db4ece4-c772-43aa-a15e-37062480e475', 'volume_size': 1, 'image_id': '03b34a00-24d0-41c0-bb11-40c718f72a52', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03b34a00-24d0-41c0-bb11-40c718f72a52', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1920008248', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16cbf713c2b4a649e34b32206baae3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '03b34a00-24d0-41c0-bb11-40c718f72a52', 'created_at': datetime.datetime(2026, 7, 3, 12, 0, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 0, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03b34a00-24d0-41c0-bb11-40c718f72a52/file', 'properties': {}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6e016b-e954-45f5-98d4-fc9bd3a91043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:08 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Volume volume-1db4ece4-c772-43aa-a15e-37062480e475 (1db4ece4-c772-43aa-a15e-37062480e475): created successfully Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6e016b-e954-45f5-98d4-fc9bd3a91043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Flow 'volume_create_manager' (83eb5dc6-fdfb-4641-a7a4-bd3db3aa1a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:08 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c5d3400e-20f4-445f-944b-fc2f841306ea tempest-TestInstancesWithCinderVolumes-1328022136 None] Created volume successfully. Jul 03 14:01:08 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c" returned: 0 in 0.888s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:08 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c Jul 03 14:01:08 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:09 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b701f52b-879c-4c1b-bf25-56e0b9d3732c" returned: 0 in 0.655s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-quobyte-b701f52b-879c-4c1b-bf25-56e0b9d3732c" released by "delete_volume" :: held 1.594s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Created reservations ['91fea5c3-e01c-42f3-8ad2-5bb0f3b85d4d', 'a5a650b7-1019-4525-a08c-f9235f55ccbc', '723c45b1-02e3-4a20-9fea-8808bcf61bdf', 'fa554505-fb9b-45b1-a3af-d8016f8a499d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:09 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:01:09 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "cinder-4a1f0415-3928-42d8-a910-caeccae775af-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-4a1f0415-3928-42d8-a910-caeccae775af-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "cinder-quobyte-4a1f0415-3928-42d8-a910-caeccae775af" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-quobyte-4a1f0415-3928-42d8-a910-caeccae775af" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcdfcbc-cecc-4da7-8e2e-83d2c735e0fb]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a1f0415-3928-42d8-a910-caeccae775af {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:10 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a1f0415-3928-42d8-a910-caeccae775af Jul 03 14:01:10 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:10 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.712s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:10 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:10 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Deleted volume successfully. Jul 03 14:01:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f74eeee8-be9c-4bd0-b443-6e9d71fe0539 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-b701f52b-879c-4c1b-bf25-56e0b9d3732c-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:10 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a1f0415-3928-42d8-a910-caeccae775af" returned: 0 in 0.930s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a1f0415-3928-42d8-a910-caeccae775af {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:10 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a1f0415-3928-42d8-a910-caeccae775af Jul 03 14:01:10 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-aebe0c69-4d3a-4214-b707-ef32bad4ffad req-e1ab2519-ce92-4029-9720-0de9f87f9504 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-aebe0c69-4d3a-4214-b707-ef32bad4ffad req-e1ab2519-ce92-4029-9720-0de9f87f9504 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0efaa2-2f02-4a51-9120-89987d79bc4e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-aebe0c69-4d3a-4214-b707-ef32bad4ffad req-e1ab2519-ce92-4029-9720-0de9f87f9504 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:11 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7 Jul 03 14:01:11 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:11 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4a1f0415-3928-42d8-a910-caeccae775af" returned: 0 in 0.727s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-quobyte-4a1f0415-3928-42d8-a910-caeccae775af" released by "delete_volume" :: held 1.709s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Created reservations ['78d84f65-9489-4e37-b7b0-9e37f371587b', 'cf7244db-36bc-4f92-a648-5e8bba44d270', 'a2d34b46-47e2-4478-b033-a54d04b82f28', '9ba82a49-109c-4454-b316-8aaacc4a76eb'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:11 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:01:11 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:12 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-aebe0c69-4d3a-4214-b707-ef32bad4ffad req-e1ab2519-ce92-4029-9720-0de9f87f9504 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7" returned: 0 in 0.868s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-aebe0c69-4d3a-4214-b707-ef32bad4ffad req-e1ab2519-ce92-4029-9720-0de9f87f9504 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.886s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-aebe0c69-4d3a-4214-b707-ef32bad4ffad req-e1ab2519-ce92-4029-9720-0de9f87f9504 tempest-AttachVolumeNegativeTest-1456526646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8ac321b-a3ee-4473-afc5-25b700109830', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:01:12 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-aebe0c69-4d3a-4214-b707-ef32bad4ffad req-e1ab2519-ce92-4029-9720-0de9f87f9504 tempest-AttachVolumeNegativeTest-1456526646 None] attachment_update completed successfully. Jul 03 14:01:12 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.719s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:12 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:12 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Deleted volume successfully. Jul 03 14:01:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8afbfd04-df1c-4063-be54-32bcedcd7642 tempest-CreateVolumesFromSourceVolumeTest-773423643 None] Lock "cinder-4a1f0415-3928-42d8-a910-caeccae775af-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-53fa1c05-1302-4816-ad5d-04bb7e43cb85 req-9f2f78c6-2444-498c-adfd-52a80a78f42f tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-53fa1c05-1302-4816-ad5d-04bb7e43cb85 req-9f2f78c6-2444-498c-adfd-52a80a78f42f tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:16 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbfe793-b425-40dc-9906-3cfaf8b579d2]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-53fa1c05-1302-4816-ad5d-04bb7e43cb85 req-9f2f78c6-2444-498c-adfd-52a80a78f42f tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:16 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 Jul 03 14:01:16 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:17 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-53fa1c05-1302-4816-ad5d-04bb7e43cb85 req-9f2f78c6-2444-498c-adfd-52a80a78f42f tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475" returned: 0 in 0.866s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-53fa1c05-1302-4816-ad5d-04bb7e43cb85 req-9f2f78c6-2444-498c-adfd-52a80a78f42f tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:17 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 Jul 03 14:01:17 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:17 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:01:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Flow 'volume_create_manager' (878b511a-0145-413a-9353-a2a63d6b7b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c0f6ed-2cc3-41d4-a75d-2229d4c053c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c0f6ed-2cc3-41d4-a75d-2229d4c053c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83331cd9-1613-4f81-b67f-83676462e2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c761b8fa7c4358b23d5a2334eba874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:18Z,use_quota=True,user_id='6492601b518449bd91625791779cd96f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e98666-e7a0-4888-bb05-83437a100f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e98666-e7a0-4888-bb05-83437a100f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc8ed94-82cb-47ef-94cd-6b8f6ed0ecb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:17 devstack cinder-volume[86729]: DEBUG cinder.image.glance [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Creating Keystone auth plugin from conf {{(pid=86729) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:01:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc8ed94-82cb-47ef-94cd-6b8f6ed0ecb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83331cd9-1613-4f81-b67f-83676462e2bd', 'volume_name': 'volume-83331cd9-1613-4f81-b67f-83676462e2bd', 'volume_size': 1, 'image_id': 'f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c121d09944f3c009c87f35295aa44fbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b5c761b8fa7c4358b23d5a2334eba874', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ea1d21669faa024cc5d77cd9bd739c4584804dfc60d1e1bf927a8acc6420da1614da8a9718134a0baaa796d04f1570ef52a95491aebfc2ebc0ed88140159967', 'id': 'f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'created_at': datetime.datetime(2026, 7, 3, 12, 1, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 1, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8a6e741-3ac3-4e77-b5ac-89a639a0030a/file', 'properties': {}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7a7252-55f5-4f80-a439-1e931b2d38e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7a7252-55f5-4f80-a439-1e931b2d38e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0763715b-ebce-4779-ad51-397910fa8f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:18 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Volume 83331cd9-1613-4f81-b67f-83676462e2bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83331cd9-1613-4f81-b67f-83676462e2bd', 'volume_size': 1, 'image_id': 'f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c121d09944f3c009c87f35295aa44fbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b5c761b8fa7c4358b23d5a2334eba874', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ea1d21669faa024cc5d77cd9bd739c4584804dfc60d1e1bf927a8acc6420da1614da8a9718134a0baaa796d04f1570ef52a95491aebfc2ebc0ed88140159967', 'id': 'f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'created_at': datetime.datetime(2026, 7, 3, 12, 1, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 1, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8a6e741-3ac3-4e77-b5ac-89a639a0030a/file', 'properties': {}}, 'image_service': } Jul 03 14:01:18 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Trying to clone 83331cd9-1613-4f81-b67f-83676462e2bd from image f8a6e741-3ac3-4e77-b5ac-89a639a0030a at location (None, [{'url': 'file:///opt/stack/data/glance/images/f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'metadata': {}}]). {{(pid=86729) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:01:18 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:01:18 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Image download 0.00 MB at 0.00 MB/s Jul 03 14:01:18 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c553c5a8-1ac1-4e6e-9db3-9e42a323f40e]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:18 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-53fa1c05-1302-4816-ad5d-04bb7e43cb85 req-9f2f78c6-2444-498c-adfd-52a80a78f42f tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475" returned: 1 in 0.932s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-53fa1c05-1302-4816-ad5d-04bb7e43cb85 req-9f2f78c6-2444-498c-adfd-52a80a78f42f tempest-TestInstancesWithCinderVolumes-1328022136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:01:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-53fa1c05-1302-4816-ad5d-04bb7e43cb85 req-9f2f78c6-2444-498c-adfd-52a80a78f42f tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.842s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:18 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD Jul 03 14:01:18 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-53fa1c05-1302-4816-ad5d-04bb7e43cb85 req-9f2f78c6-2444-498c-adfd-52a80a78f42f tempest-TestInstancesWithCinderVolumes-1328022136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-1db4ece4-c772-43aa-a15e-37062480e475', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b360541-fb19-445e-a081-9a19109ba0b1', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:01:18 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-53fa1c05-1302-4816-ad5d-04bb7e43cb85 req-9f2f78c6-2444-498c-adfd-52a80a78f42f tempest-TestInstancesWithCinderVolumes-1328022136 None] attachment_update completed successfully. Jul 03 14:01:19 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD" returned: 0 in 0.741s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:19 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD Jul 03 14:01:19 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:19 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-512d2e08-6a24-488f-ac32-da7570d5a9b0 req-21b9d998-1ca1-4e0d-bc21-49383628fc2b tempest-AttachVolumeNegativeTest-1456526646 None] Terminate volume connection completed successfully. Jul 03 14:01:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-512d2e08-6a24-488f-ac32-da7570d5a9b0 req-21b9d998-1ca1-4e0d-bc21-49383628fc2b tempest-AttachVolumeNegativeTest-1456526646 None] Deleting attachment b8ac321b-a3ee-4473-afc5-25b700109830. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:01:19 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD" returned: 1 in 0.828s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:01:20 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Temporary image f8a6e741-3ac3-4e77-b5ac-89a639a0030a is fetched for user 6492601b518449bd91625791779cd96f. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:01:20 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f999e0f1-2bcb-4280-9f43-3ed2f19f6401]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:20 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD Jul 03 14:01:20 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:20 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD" returned: 0 in 0.747s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:20 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD Jul 03 14:01:20 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:21 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD" returned: 1 in 0.735s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83331cd9-1613-4f81-b67f-83676462e2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c761b8fa7c4358b23d5a2334eba874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:01:18Z,use_quota=True,user_id='6492601b518449bd91625791779cd96f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Creating volume 83331cd9-1613-4f81-b67f-83676462e2bd {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:01:21 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:01:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:21 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd 1073741824 Jul 03 14:01:21 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:22 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd 1073741824" returned: 0 in 0.853s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:22 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd Jul 03 14:01:22 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:23 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd" returned: 0 in 0.735s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:01:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:23 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Attempting download of f8a6e741-3ac3-4e77-b5ac-89a639a0030a ((None, [{'url': 'file:///opt/stack/data/glance/images/f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'metadata': {}}])) to volume 83331cd9-1613-4f81-b67f-83676462e2bd. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:01:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a6e512-e87a-4e20-ab73-958691eaafed]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_zhjdch29 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:23 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_zhjdch29 Jul 03 14:01:23 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:24 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_zhjdch29" returned: 0 in 1.229s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_zhjdch29 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:24 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_zhjdch29 Jul 03 14:01:24 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:25 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_zhjdch29" returned: 1 in 0.929s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_zhjdch29' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:01:25 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8210ad-ae06-400a-99c9-c48945bb0764]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:25 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD Jul 03 14:01:25 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:01:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:26 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:01:26 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:26 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD" returned: 0 in 0.910s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:26 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD Jul 03 14:01:26 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:26 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.907s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:27 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD" returned: 1 in 0.854s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:01:27 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] f8a6e741-3ac3-4e77-b5ac-89a639a0030a was raw, converting to raw {{(pid=86729) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:01:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:27 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd Jul 03 14:01:27 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:28 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd" returned: 0 in 0.771s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:28 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f8a6e741-3ac3-4e77-b5ac-89a639a0030a_opx9g6j_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:01:28 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 14:01:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:28 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd 1G Jul 03 14:01:28 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:28 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd 1G" returned: 0 in 0.935s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:29 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8f97dc-a985-47ef-8e2a-ce79b64ed929]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:29 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd Jul 03 14:01:29 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:29 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd" returned: 0 in 0.888s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:30 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd Jul 03 14:01:30 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "cinder-4127aa3d-55d9-4c32-8ec3-5232f005ecf7-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Lock "cinder-4127aa3d-55d9-4c32-8ec3-5232f005ecf7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=94,cinder:UPDATE=110,cinder:INSERT=27,cinder:DELETE=7 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "cinder-quobyte-4127aa3d-55d9-4c32-8ec3-5232f005ecf7" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Lock "cinder-quobyte-4127aa3d-55d9-4c32-8ec3-5232f005ecf7" acquired by "delete_volume" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ebbb88-f25c-443c-9b37-5df0870918c5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:31 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd" returned: 1 in 1.533s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Downloaded image f8a6e741-3ac3-4e77-b5ac-89a639a0030a ((None, [{'url': 'file:///opt/stack/data/glance/images/f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'metadata': {}}])) to volume 83331cd9-1613-4f81-b67f-83676462e2bd successfully. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Temporary image f8a6e741-3ac3-4e77-b5ac-89a639a0030a for user 6492601b518449bd91625791779cd96f is deleted. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Marking volume 83331cd9-1613-4f81-b67f-83676462e2bd as bootable. {{(pid=86729) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Copying metadata from image f8a6e741-3ac3-4e77-b5ac-89a639a0030a to 83331cd9-1613-4f81-b67f-83676462e2bd. {{(pid=86729) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Creating volume glance metadata for volume 83331cd9-1613-4f81-b67f-83676462e2bd backed by image f8a6e741-3ac3-4e77-b5ac-89a639a0030a with: {'image_id': 'f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c121d09944f3c009c87f35295aa44fbf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86729) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:01:31 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7 Jul 03 14:01:31 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0763715b-ebce-4779-ad51-397910fa8f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83331cd9-1613-4f81-b67f-83676462e2bd', 'volume_size': 1, 'image_id': 'f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c121d09944f3c009c87f35295aa44fbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b5c761b8fa7c4358b23d5a2334eba874', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ea1d21669faa024cc5d77cd9bd739c4584804dfc60d1e1bf927a8acc6420da1614da8a9718134a0baaa796d04f1570ef52a95491aebfc2ebc0ed88140159967', 'id': 'f8a6e741-3ac3-4e77-b5ac-89a639a0030a', 'created_at': datetime.datetime(2026, 7, 3, 12, 1, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 1, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8a6e741-3ac3-4e77-b5ac-89a639a0030a/file', 'properties': {}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b45336b-099d-4c4a-80eb-40b06b8c640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:01:31 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Volume volume-83331cd9-1613-4f81-b67f-83676462e2bd (83331cd9-1613-4f81-b67f-83676462e2bd): created successfully Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b45336b-099d-4c4a-80eb-40b06b8c640c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:01:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Flow 'volume_create_manager' (878b511a-0145-413a-9353-a2a63d6b7b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:01:31 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6d7a263a-cc82-486d-95f4-70a0fa39157e tempest-VolumeImageDependencyTests-630750987 None] Created volume successfully. Jul 03 14:01:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Acquiring lock "cinder-83331cd9-1613-4f81-b67f-83676462e2bd-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Lock "cinder-83331cd9-1613-4f81-b67f-83676462e2bd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Acquiring lock "cinder-quobyte-83331cd9-1613-4f81-b67f-83676462e2bd" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Lock "cinder-quobyte-83331cd9-1613-4f81-b67f-83676462e2bd" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7ba97a-c946-4ea1-beac-801139e49510]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:32 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd Jul 03 14:01:32 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:32 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7" returned: 0 in 1.350s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:32 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7 Jul 03 14:01:32 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:33 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4127aa3d-55d9-4c32-8ec3-5232f005ecf7" returned: 0 in 0.901s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Lock "cinder-quobyte-4127aa3d-55d9-4c32-8ec3-5232f005ecf7" released by "delete_volume" :: held 2.333s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:33 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Created reservations ['29b475a3-50af-46b5-9998-fd0d2f39d923', '73edcb6b-352f-4cbc-95ec-926710949107', '740dd27f-cb9d-448a-bb61-cdbed8348d70', '2f581233-3596-45ce-95f5-433f83f653f1'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:33 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd" returned: 0 in 1.344s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:33 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:01:33 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:33 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd Jul 03 14:01:33 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:34 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.688s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:34 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Deleted volume successfully. Jul 03 14:01:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eb83aa1b-e615-4cfa-ac7e-d89303e1627d tempest-AttachVolumeNegativeTest-1456526646 None] Lock "cinder-4127aa3d-55d9-4c32-8ec3-5232f005ecf7-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:34 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd" returned: 1 in 1.116s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:01:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "cinder-13d37553-4ebd-409f-bce3-69780dcc06ed-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:34 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd Jul 03 14:01:34 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "cinder-13d37553-4ebd-409f-bce3-69780dcc06ed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "cinder-quobyte-13d37553-4ebd-409f-bce3-69780dcc06ed" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "cinder-quobyte-13d37553-4ebd-409f-bce3-69780dcc06ed" acquired by "delete_volume" :: waited 0.042s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:35 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c7a56d-b316-4726-9f52-4bc9048e38ac]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:35 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed Jul 03 14:01:35 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:35 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-83331cd9-1613-4f81-b67f-83676462e2bd" returned: 0 in 1.092s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Lock "cinder-quobyte-83331cd9-1613-4f81-b67f-83676462e2bd" released by "delete_volume" :: held 3.672s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:36 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Created reservations ['c0e15cdf-eb29-4749-8cdf-aa56752236a4', 'b02e2f34-5f2c-4f7b-83a2-96a5747c8692', 'e1cb180f-281b-457d-ab72-01e585fbb661', '8deddeee-d787-48ec-9c7a-72e6f1996071'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:36 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed" returned: 0 in 1.001s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:36 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed Jul 03 14:01:36 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:36 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:01:36 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:36 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-13d37553-4ebd-409f-bce3-69780dcc06ed" returned: 0 in 0.805s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "cinder-quobyte-13d37553-4ebd-409f-bce3-69780dcc06ed" released by "delete_volume" :: held 1.880s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Created reservations ['3ebb2edb-1877-49c8-805e-82bc9e0070d3', 'f3d8f9ae-6c8c-454b-a5cd-67ace71e21d8', '55788aa0-ce16-469b-a258-2c17e02bf8cf', 'd6c7af47-1a39-4707-b351-d25e1db8f209'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:37 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.875s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:37 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Deleted volume successfully. Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6d0ab564-4696-4e26-b1be-62a042a2e7f3 tempest-VolumeImageDependencyTests-630750987 None] Lock "cinder-83331cd9-1613-4f81-b67f-83676462e2bd-delete_volume" released by "delete_volume" :: held 4.935s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:37 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:01:37 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "cinder-49483f64-03fd-4400-b7b7-41db69135a2a-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "cinder-49483f64-03fd-4400-b7b7-41db69135a2a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "cinder-quobyte-49483f64-03fd-4400-b7b7-41db69135a2a" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "cinder-quobyte-49483f64-03fd-4400-b7b7-41db69135a2a" acquired by "delete_volume" :: waited 0.052s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[238ed13b-2f8a-4593-9280-b0ff6b5580ab]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:37 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a Jul 03 14:01:37 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:38 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.930s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:38 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Deleted volume successfully. Jul 03 14:01:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a523686e-8e48-436f-b605-ff77fa613b49 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "cinder-13d37553-4ebd-409f-bce3-69780dcc06ed-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:38 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a" returned: 0 in 0.885s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:38 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a Jul 03 14:01:38 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:39 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49483f64-03fd-4400-b7b7-41db69135a2a" returned: 0 in 0.680s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "cinder-quobyte-49483f64-03fd-4400-b7b7-41db69135a2a" released by "delete_volume" :: held 1.618s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:39 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Created reservations ['153df322-ff41-442b-8604-46e528960edc', '7a26211e-e793-41dc-b427-74c49b44cdf2', '38e948f8-d9e6-40ae-ab77-77fbabf763c5', 'a991f689-6516-4dd4-9623-d4113a3cb5da'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:01:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:01:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:01:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:39 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:01:39 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:40 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.925s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:40 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:01:40 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Deleted volume successfully. Jul 03 14:01:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f551b122-2aec-471d-9e9f-aed8c4bb2337 tempest-AttachVolumeNegativeTest-1456526646 None] Lock "cinder-49483f64-03fd-4400-b7b7-41db69135a2a-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:01:49 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=39,cinder:SELECT=21,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:01:50 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=93,cinder:DELETE=11,cinder:SELECT=78,cinder:INSERT=33 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:01:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-fe80bac9-6779-4fdb-be67-c03337a360fc req-7beec275-c4a4-468e-a20d-f949a6ea5430 tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:01:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-fe80bac9-6779-4fdb-be67-c03337a360fc req-7beec275-c4a4-468e-a20d-f949a6ea5430 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:01:58 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b033bf1e-fc23-480e-bc84-6d6ef2c068b9]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:01:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-fe80bac9-6779-4fdb-be67-c03337a360fc req-7beec275-c4a4-468e-a20d-f949a6ea5430 tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:01:58 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd Jul 03 14:01:58 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:01:59 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Jul 03 14:01:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-fe80bac9-6779-4fdb-be67-c03337a360fc req-7beec275-c4a4-468e-a20d-f949a6ea5430 tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd" returned: 0 in 0.836s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:01:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-fe80bac9-6779-4fdb-be67-c03337a360fc req-7beec275-c4a4-468e-a20d-f949a6ea5430 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.862s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:01:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-fe80bac9-6779-4fdb-be67-c03337a360fc req-7beec275-c4a4-468e-a20d-f949a6ea5430 tempest-TestInstancesWithCinderVolumes-1328022136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b3e8e4e-cb4d-4cd5-bd0f-859eea06dc42', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:01:59 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-fe80bac9-6779-4fdb-be67-c03337a360fc req-7beec275-c4a4-468e-a20d-f949a6ea5430 tempest-TestInstancesWithCinderVolumes-1328022136 None] attachment_update completed successfully. Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Flow 'volume_create_manager' (5ae9c716-61d2-4b63-90c7-042645139369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bee1d3-85ed-482c-b02c-b70f7bab2bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bee1d3-85ed-482c-b02c-b70f7bab2bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-328332673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55edf0f0-3356-4d6a-bd1d-117fb57cb3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbf0ffa509e474797337a908faf25c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:05Z,use_quota=True,user_id='1fbc83d9e9bf4926b00fd17bdf0b6e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe43b64-1064-420a-b5e7-b5376256e4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe43b64-1064-420a-b5e7-b5376256e4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983554cc-9b53-4fc2-874c-b2d4e459691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983554cc-9b53-4fc2-874c-b2d4e459691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55edf0f0-3356-4d6a-bd1d-117fb57cb3fd', 'volume_name': 'volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7410fab-c0a7-4cae-9ca3-5cd793ced976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7410fab-c0a7-4cae-9ca3-5cd793ced976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117dba78-f020-4254-ae15-ef17f13cee25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:05 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Volume 55edf0f0-3356-4d6a-bd1d-117fb57cb3fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd', 'volume_size': 1} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-328332673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55edf0f0-3356-4d6a-bd1d-117fb57cb3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbf0ffa509e474797337a908faf25c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:05Z,use_quota=True,user_id='1fbc83d9e9bf4926b00fd17bdf0b6e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Creating volume 55edf0f0-3356-4d6a-bd1d-117fb57cb3fd {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:05 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:02:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:05 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd 1073741824 Jul 03 14:02:05 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:06 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd 1073741824" returned: 0 in 0.919s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:06 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd Jul 03 14:02:06 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:06 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd" returned: 0 in 0.709s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117dba78-f020-4254-ae15-ef17f13cee25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb17efe8-35e7-41db-a846-8133f5af7a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:07 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Volume volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd (55edf0f0-3356-4d6a-bd1d-117fb57cb3fd): created successfully Jul 03 14:02:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb17efe8-35e7-41db-a846-8133f5af7a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Flow 'volume_create_manager' (5ae9c716-61d2-4b63-90c7-042645139369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:07 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-4181c5ee-fa98-4c2c-9e19-654621e019a6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Created volume successfully. Jul 03 14:02:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Acquiring lock "cinder-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "cinder-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Acquiring lock "cinder-quobyte-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "cinder-quobyte-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:07 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b076626-29f5-4568-94c6-d4b3d34db970]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:07 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd Jul 03 14:02:07 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:08 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd" returned: 0 in 0.978s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:08 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd Jul 03 14:02:08 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-ae3d0815-c249-47f4-887c-dc8ee7844571 req-9bb8f440-a4c6-45d1-86cd-66369e689d77 tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-ae3d0815-c249-47f4-887c-dc8ee7844571 req-9bb8f440-a4c6-45d1-86cd-66369e689d77 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:08 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb00bb9-4dad-40c4-a3a3-00d146041038]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-ae3d0815-c249-47f4-887c-dc8ee7844571 req-9bb8f440-a4c6-45d1-86cd-66369e689d77 tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:08 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59 Jul 03 14:02:08 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:09 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd" returned: 0 in 0.730s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "cinder-quobyte-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd" released by "delete_volume" :: held 1.770s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:09 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Created reservations ['71a2cbca-ae27-40b9-b8f5-f3ea2b074bd2', '7bdfa811-6538-495c-8d76-1a3d1acd8e18', '3fd80dbc-5619-4eba-bfed-c6c71b5c2a8d', 'dd8457aa-8a2c-4323-80c3-e4388d239040'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:09 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:02:09 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:09 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-ae3d0815-c249-47f4-887c-dc8ee7844571 req-9bb8f440-a4c6-45d1-86cd-66369e689d77 tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59" returned: 0 in 0.836s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-ae3d0815-c249-47f4-887c-dc8ee7844571 req-9bb8f440-a4c6-45d1-86cd-66369e689d77 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:09 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-ae3d0815-c249-47f4-887c-dc8ee7844571 req-9bb8f440-a4c6-45d1-86cd-66369e689d77 tempest-TestInstancesWithCinderVolumes-1328022136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-022d759e-32a0-460e-8239-3b7e50037c59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a190c26-e6f3-40ed-85ff-aa49d99acbc6', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:02:09 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-ae3d0815-c249-47f4-887c-dc8ee7844571 req-9bb8f440-a4c6-45d1-86cd-66369e689d77 tempest-TestInstancesWithCinderVolumes-1328022136 None] attachment_update completed successfully. Jul 03 14:02:10 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.756s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:10 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Deleted volume successfully. Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aee2b995-66b4-4d5a-813d-bd1f48bf3ae9 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "cinder-55edf0f0-3356-4d6a-bd1d-117fb57cb3fd-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Flow 'volume_create_manager' (8ea2d345-8b9e-4308-9606-d11980f333ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e66710-0478-420e-88ef-d46bb045963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e66710-0478-420e-88ef-d46bb045963f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2040328340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94afdc74-b991-47be-a032-07e9c196da34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbf0ffa509e474797337a908faf25c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:10Z,use_quota=True,user_id='1fbc83d9e9bf4926b00fd17bdf0b6e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f743894-4bf9-4300-8ca2-1e92f1827288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f743894-4bf9-4300-8ca2-1e92f1827288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b678e99-ea69-45cc-b200-33b4273d73c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b678e99-ea69-45cc-b200-33b4273d73c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94afdc74-b991-47be-a032-07e9c196da34', 'volume_name': 'volume-94afdc74-b991-47be-a032-07e9c196da34', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2669fdbc-652a-4898-bae0-510ce9875116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2669fdbc-652a-4898-bae0-510ce9875116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdc002a-c111-4dd2-bbf8-d911adaba94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:10 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Volume 94afdc74-b991-47be-a032-07e9c196da34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94afdc74-b991-47be-a032-07e9c196da34', 'volume_size': 1} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2040328340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94afdc74-b991-47be-a032-07e9c196da34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbf0ffa509e474797337a908faf25c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:10Z,use_quota=True,user_id='1fbc83d9e9bf4926b00fd17bdf0b6e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Creating volume 94afdc74-b991-47be-a032-07e9c196da34 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:10 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:02:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94afdc74-b991-47be-a032-07e9c196da34 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:10 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94afdc74-b991-47be-a032-07e9c196da34 1073741824 Jul 03 14:02:10 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:11 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94afdc74-b991-47be-a032-07e9c196da34 1073741824" returned: 0 in 0.889s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94afdc74-b991-47be-a032-07e9c196da34 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:11 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94afdc74-b991-47be-a032-07e9c196da34 Jul 03 14:02:11 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:12 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94afdc74-b991-47be-a032-07e9c196da34" returned: 0 in 0.707s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdc002a-c111-4dd2-bbf8-d911adaba94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94afdc74-b991-47be-a032-07e9c196da34', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19905a8d-da2b-4093-9627-88a7930d54d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:12 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Volume volume-94afdc74-b991-47be-a032-07e9c196da34 (94afdc74-b991-47be-a032-07e9c196da34): created successfully Jul 03 14:02:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19905a8d-da2b-4093-9627-88a7930d54d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Flow 'volume_create_manager' (8ea2d345-8b9e-4308-9606-d11980f333ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:12 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a71bf69a-ff20-4118-8999-84b34a92e5b6 tempest-VolumeQuotasAdminTestJSON-606385623 None] Created volume successfully. Jul 03 14:02:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e62ab230-340c-42f7-a404-4ba849c43a74 tempest-VolumeQuotasAdminTestJSON-689419921 None] Transfer volume completed successfully. Jul 03 14:02:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Acquiring lock "cinder-94afdc74-b991-47be-a032-07e9c196da34-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Lock "cinder-94afdc74-b991-47be-a032-07e9c196da34-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Acquiring lock "cinder-quobyte-94afdc74-b991-47be-a032-07e9c196da34" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Lock "cinder-quobyte-94afdc74-b991-47be-a032-07e9c196da34" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:14 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6378dc18-abaf-401c-91be-926081f15821]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94afdc74-b991-47be-a032-07e9c196da34 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:14 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94afdc74-b991-47be-a032-07e9c196da34 Jul 03 14:02:14 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:15 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94afdc74-b991-47be-a032-07e9c196da34" returned: 0 in 0.872s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94afdc74-b991-47be-a032-07e9c196da34 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:15 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94afdc74-b991-47be-a032-07e9c196da34 Jul 03 14:02:15 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Flow 'volume_create_manager' (6def00cd-3ec8-4ca1-8e3a-cb66b0d29ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab8a044-fa24-4b01-b29a-d7ee4753deaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab8a044-fa24-4b01-b29a-d7ee4753deaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-573142823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80561d64-63d1-44ce-b0e3-84b9be64826b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8693350e4c854079bc1d1ec5fbeeebd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:16Z,use_quota=True,user_id='e832a98d30214e388e62ba92e989b933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f21521-dff8-4785-a781-726b993d2e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f21521-dff8-4785-a781-726b993d2e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cef099e-5a0d-4e26-9f57-c36b130340eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cef099e-5a0d-4e26-9f57-c36b130340eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80561d64-63d1-44ce-b0e3-84b9be64826b', 'volume_name': 'volume-80561d64-63d1-44ce-b0e3-84b9be64826b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b219a2a5-3a3b-4478-8733-ec830ddb2efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b219a2a5-3a3b-4478-8733-ec830ddb2efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bbc948-77d7-4c1f-a38f-35d810653391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:15 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Volume 80561d64-63d1-44ce-b0e3-84b9be64826b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80561d64-63d1-44ce-b0e3-84b9be64826b', 'volume_size': 1} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-573142823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80561d64-63d1-44ce-b0e3-84b9be64826b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8693350e4c854079bc1d1ec5fbeeebd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:16Z,use_quota=True,user_id='e832a98d30214e388e62ba92e989b933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Creating volume 80561d64-63d1-44ce-b0e3-84b9be64826b {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:15 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:02:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:15 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b 1073741824 Jul 03 14:02:15 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:16 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94afdc74-b991-47be-a032-07e9c196da34" returned: 0 in 0.748s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Lock "cinder-quobyte-94afdc74-b991-47be-a032-07e9c196da34" released by "delete_volume" :: held 1.669s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:16 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Created reservations ['8c490813-8f23-4ab4-a339-6e82f4e52703', '89751765-7224-47ff-a1c4-7337821a05ff', '6a024ce9-137d-4bc1-9a0c-ae7d11966ccc', 'eeefbec5-c858-457d-8b12-bacbf74115e7'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:16 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:02:16 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:16 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b 1073741824" returned: 0 in 1.052s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:16 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b Jul 03 14:02:16 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:17 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.798s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:17 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Deleted volume successfully. Jul 03 14:02:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bcc3c2c0-b7f8-4b14-a950-a7784a0b3b15 tempest-VolumeQuotasAdminTestJSON-1869209835 None] Lock "cinder-94afdc74-b991-47be-a032-07e9c196da34-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:17 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b" returned: 0 in 0.742s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bbc948-77d7-4c1f-a38f-35d810653391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80561d64-63d1-44ce-b0e3-84b9be64826b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fb0944-df0a-4aa5-a88c-300d0061d6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:17 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Volume volume-80561d64-63d1-44ce-b0e3-84b9be64826b (80561d64-63d1-44ce-b0e3-84b9be64826b): created successfully Jul 03 14:02:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fb0944-df0a-4aa5-a88c-300d0061d6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Flow 'volume_create_manager' (6def00cd-3ec8-4ca1-8e3a-cb66b0d29ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-2a2dec51-bc20-443c-9710-883a20b8d374 tempest-SnapshotDependencyTests-273318636 None] Created volume successfully. Jul 03 14:02:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] Creating offline snapshot 8e033232-4632-4559-a32e-65866468e295 of volume 80561d64-63d1-44ce-b0e3-84b9be64826b {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:02:19 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e03a095-641c-4476-aca7-8e999b1293fb]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:19 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b Jul 03 14:02:19 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:19 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-88c4f4d4-ce64-4b21-8dce-984d1d6699a3 req-be7cae13-072d-429e-8fa1-ab936e348b5b tempest-TestInstancesWithCinderVolumes-1328022136 None] Terminate volume connection completed successfully. Jul 03 14:02:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-88c4f4d4-ce64-4b21-8dce-984d1d6699a3 req-be7cae13-072d-429e-8fa1-ab936e348b5b tempest-TestInstancesWithCinderVolumes-1328022136 None] Deleting attachment 2b3e8e4e-cb4d-4cd5-bd0f-859eea06dc42. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:02:20 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b" returned: 0 in 0.968s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:20 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 1G Jul 03 14:02:20 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:20 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 1G" returned: 0 in 0.930s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80561d64-63d1-44ce-b0e3-84b9be64826b -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:21 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80561d64-63d1-44ce-b0e3-84b9be64826b -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 Jul 03 14:02:21 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:21 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "cinder-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:21 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "cinder-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:21 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "cinder-quobyte-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:21 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "cinder-quobyte-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:21 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3af9f5-cb41-4469-b054-abf36e574f88]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:21 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd Jul 03 14:02:21 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:21 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80561d64-63d1-44ce-b0e3-84b9be64826b -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295" returned: 0 in 0.857s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:21 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 is being set with open permissions: ugo+rw Jul 03 14:02:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:21 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 Jul 03 14:02:21 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:22 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd" returned: 0 in 0.938s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:22 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd Jul 03 14:02:22 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:22 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295" returned: 0 in 0.780s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:22 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.info Jul 03 14:02:22 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:23 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd" returned: 0 in 0.795s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "cinder-quobyte-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd" released by "delete_volume" :: held 1.795s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:23 devstack cinder-volume[86729]: WARNING cinder.quota [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-76673450-413267120 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-76673450-413267120, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:02:23 devstack cinder-volume[86729]: WARNING cinder.quota [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-76673450-413267120 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-76673450-413267120, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:02:23 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Created reservations ['70f72f28-b2e9-4560-971f-dd3d57d764c5', '9ef0ad06-e2a8-49c6-a4ac-87ecf9e08eed', '28d731d1-2e7d-4c26-b6cd-da583d033bd8', '39af2ecd-69e7-42c4-b841-3b21244cf6b5'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:23 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:02:23 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:23 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.info" returned: 0 in 0.777s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:23 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.info is being set with open permissions: ugo+rw Jul 03 14:02:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:23 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.info Jul 03 14:02:23 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:24 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.763s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:24 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Deleted volume successfully. Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c56e378f-1e9f-4f6d-9014-99c58b0ef8be tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "cinder-c850bd49-7dd5-44b0-b5b0-8eee551ca6cd-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:24 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.info" returned: 0 in 0.750s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.185s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:24 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6780c053-d3d2-401b-be39-e54c2711ee34 tempest-SnapshotDependencyTests-273318636 None] Create snapshot completed successfully Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Flow 'volume_create_manager' (e89e679d-db14-445d-b3bd-00d814114a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58987e5-6f23-4b90-bb48-7ffcb6f600ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58987e5-6f23-4b90-bb48-7ffcb6f600ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-373522413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1857ed43-cfe1-4dc4-9722-f16016f2bbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5334ff9cf50149a08bcafd4516c761e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:25Z,use_quota=True,user_id='58f5e97f40394994a200681058c19172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7036cea1-80f1-42ef-8359-06e6f8a9757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7036cea1-80f1-42ef-8359-06e6f8a9757e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f791a3-fe89-4538-bab5-56ee4b1b1fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f791a3-fe89-4538-bab5-56ee4b1b1fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1857ed43-cfe1-4dc4-9722-f16016f2bbfb', 'volume_name': 'volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be06f600-b49e-49f1-ad76-7089bb105f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be06f600-b49e-49f1-ad76-7089bb105f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0d43a8-e090-45ab-a486-106d3d83bc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:24 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Volume 1857ed43-cfe1-4dc4-9722-f16016f2bbfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb', 'volume_size': 1} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-373522413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1857ed43-cfe1-4dc4-9722-f16016f2bbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5334ff9cf50149a08bcafd4516c761e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:25Z,use_quota=True,user_id='58f5e97f40394994a200681058c19172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Creating volume 1857ed43-cfe1-4dc4-9722-f16016f2bbfb {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:24 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:02:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:24 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb 1073741824 Jul 03 14:02:24 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:25 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb 1073741824" returned: 0 in 0.825s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:25 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb Jul 03 14:02:25 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:25 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Flow 'volume_create_manager' (36a62527-7728-4b0a-99a7-faa179215989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12683486-71c9-410a-b43d-4a42c555d7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12683486-71c9-410a-b43d-4a42c555d7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fe2d77-eee0-466a-80be-12fa92765c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8693350e4c854079bc1d1ec5fbeeebd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e033232-4632-4559-a32e-65866468e295,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:26Z,use_quota=True,user_id='e832a98d30214e388e62ba92e989b933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef647923-17ee-4549-8426-19cb9c8c4df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef647923-17ee-4549-8426-19cb9c8c4df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1429d576-39d4-49f5-b11d-7da055e3da61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1429d576-39d4-49f5-b11d-7da055e3da61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64fe2d77-eee0-466a-80be-12fa92765c46', 'volume_name': 'volume-64fe2d77-eee0-466a-80be-12fa92765c46', 'volume_size': 1, 'snapshot_id': '8e033232-4632-4559-a32e-65866468e295'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e8e1a4-e5aa-4a0b-b84f-9faba783675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e8e1a4-e5aa-4a0b-b84f-9faba783675d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5f5f71-037d-4b4e-a5a8-e0aa832cf7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:26 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Volume 64fe2d77-eee0-466a-80be-12fa92765c46: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64fe2d77-eee0-466a-80be-12fa92765c46', 'volume_size': 1, 'snapshot_id': '8e033232-4632-4559-a32e-65866468e295'} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:26 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:02:26 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:26 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-abeccb2a-10ce-41ea-8981-7aa1a619e160 req-cf7f2902-d23d-47bc-a0ff-5f0ce449986f tempest-TestInstancesWithCinderVolumes-1328022136 None] Terminate volume connection completed successfully. Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-abeccb2a-10ce-41ea-8981-7aa1a619e160 req-cf7f2902-d23d-47bc-a0ff-5f0ce449986f tempest-TestInstancesWithCinderVolumes-1328022136 None] Deleting attachment 7a190c26-e6f3-40ed-85ff-aa49d99acbc6. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:02:26 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb" returned: 0 in 0.662s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.370s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "cinder-quobyte-8e033232-4632-4559-a32e-65866468e295-64fe2d77-eee0-466a-80be-12fa92765c46" by "_create_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0d43a8-e090-45ab-a486-106d3d83bc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d33a996-d7b8-418d-9b0a-e98a85cdf628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-quobyte-8e033232-4632-4559-a32e-65866468e295-64fe2d77-eee0-466a-80be-12fa92765c46" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Creating volume 64fe2d77-eee0-466a-80be-12fa92765c46 from snapshot 8e033232-4632-4559-a32e-65866468e295 {{(pid=86729) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "cinder-quobyte-64fe2d77-eee0-466a-80be-12fa92765c46" by "_copy_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:26 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Volume volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb (1857ed43-cfe1-4dc4-9722-f16016f2bbfb): created successfully Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d33a996-d7b8-418d-9b0a-e98a85cdf628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Flow 'volume_create_manager' (e89e679d-db14-445d-b3bd-00d814114a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-quobyte-64fe2d77-eee0-466a-80be-12fa92765c46" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] snapshot: 8e033232-4632-4559-a32e-65866468e295, volume: 64fe2d77-eee0-466a-80be-12fa92765c46, {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:02:26 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-eef929f2-186a-4dd6-b45a-1c41c7c1c6a7 tempest-VolumesServicesTestJSON-443846944 None] Created volume successfully. Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed3c707-eb8f-409a-a959-113e21eac539]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:26 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 Jul 03 14:02:26 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:26 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.647s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Acquiring lock "cinder-1857ed43-cfe1-4dc4-9722-f16016f2bbfb-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Lock "cinder-1857ed43-cfe1-4dc4-9722-f16016f2bbfb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Acquiring lock "cinder-quobyte-1857ed43-cfe1-4dc4-9722-f16016f2bbfb" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Lock "cinder-quobyte-1857ed43-cfe1-4dc4-9722-f16016f2bbfb" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f2b2ad-e2fa-4ea8-a8aa-9ce4c413de24]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:27 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb Jul 03 14:02:27 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:27 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295" returned: 0 in 0.795s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80561d64-63d1-44ce-b0e3-84b9be64826b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] will copy from snapshot at /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Creating direct copy from snapshot {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7b82c7-7bc4-4d84-8c23-d9924af1be36]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:27 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b Jul 03 14:02:27 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:27 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb" returned: 0 in 0.782s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:27 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb Jul 03 14:02:27 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:28 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b" returned: 0 in 0.768s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG cinder.utils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Path /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46 not found in is_blk_device check {{(pid=86729) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:28 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46 Jul 03 14:02:28 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "cinder-022d759e-32a0-460e-8239-3b7e50037c59-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "cinder-022d759e-32a0-460e-8239-3b7e50037c59-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "cinder-quobyte-022d759e-32a0-460e-8239-3b7e50037c59" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "cinder-quobyte-022d759e-32a0-460e-8239-3b7e50037c59" acquired by "delete_volume" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f069a2a-e02c-4cce-9daf-bc4469e77ba7]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:28 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59 Jul 03 14:02:28 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:28 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1857ed43-cfe1-4dc4-9722-f16016f2bbfb" returned: 0 in 0.680s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Lock "cinder-quobyte-1857ed43-cfe1-4dc4-9722-f16016f2bbfb" released by "delete_volume" :: held 1.506s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Created reservations ['5d242b3e-c573-402f-bd13-8bd0282d9b41', '1ea54dee-80cc-4046-b042-ea8c804486c2', '94538ff4-2694-413a-89d1-3752370d35f8', 'a09cd3a3-4a1c-4e1f-95e2-9f3263e1021f'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:28 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:02:28 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:29 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59" returned: 0 in 1.530s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:29 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59 Jul 03 14:02:29 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:30 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.622s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:30 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:30 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Deleted volume successfully. Jul 03 14:02:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b0788fd5-fcb9-40b3-b5e2-70c84910b319 tempest-VolumesServicesTestJSON-443846944 None] Lock "cinder-1857ed43-cfe1-4dc4-9722-f16016f2bbfb-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:31 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-022d759e-32a0-460e-8239-3b7e50037c59" returned: 0 in 1.788s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "cinder-quobyte-022d759e-32a0-460e-8239-3b7e50037c59" released by "delete_volume" :: held 3.412s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:31 devstack cinder-volume[86729]: WARNING cinder.quota [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-165179963-767703780 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-165179963-767703780, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:02:31 devstack cinder-volume[86729]: WARNING cinder.quota [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-165179963-767703780 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-165179963-767703780, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:02:32 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Created reservations ['59112921-73f1-4d25-8019-d16546f0fa6b', '93646286-450c-451b-bb2d-ba8986e53803', 'f28eceef-7d83-49f7-a641-da0b355db034', 'dd3a963c-5a6b-4ce1-a945-4534b73b7e50'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:32 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:02:32 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:33 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.720s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:33 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:33 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Deleted volume successfully. Jul 03 14:02:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b5a3b229-d8f1-43b5-91a9-6c036413815a tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "cinder-022d759e-32a0-460e-8239-3b7e50037c59-delete_volume" released by "delete_volume" :: held 5.760s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:34 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46" returned: 0 in 6.616s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:34 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[315d446a-47ad-49c8-851f-d083a2ccf34b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:35 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b Jul 03 14:02:35 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:36 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b" returned: 0 in 1.479s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:36 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:02:36 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Converted 1024.00 MB image at 154.72 MB/s Jul 03 14:02:36 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46 is being set with open permissions: ugo+rw Jul 03 14:02:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:36 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46 Jul 03 14:02:36 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:37 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46" returned: 0 in 0.985s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-quobyte-64fe2d77-eee0-466a-80be-12fa92765c46" released by "_copy_volume_from_snapshot" :: held 10.760s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-quobyte-8e033232-4632-4559-a32e-65866468e295-64fe2d77-eee0-466a-80be-12fa92765c46" released by "_create_volume_from_snapshot" :: held 10.813s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.849s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5f5f71-037d-4b4e-a5a8-e0aa832cf7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64fe2d77-eee0-466a-80be-12fa92765c46', 'volume_size': 1, 'snapshot_id': '8e033232-4632-4559-a32e-65866468e295'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c347fb-4ab4-4880-83f9-beff2fad7c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:37 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Volume volume-64fe2d77-eee0-466a-80be-12fa92765c46 (64fe2d77-eee0-466a-80be-12fa92765c46): created successfully Jul 03 14:02:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c347fb-4ab4-4880-83f9-beff2fad7c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Flow 'volume_create_manager' (36a62527-7728-4b0a-99a7-faa179215989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:37 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-53efca17-32b2-4121-934f-1226d45e26de tempest-SnapshotDependencyTests-273318636 None] Created volume successfully. Jul 03 14:02:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "cinder-8e033232-4632-4559-a32e-65866468e295-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-8e033232-4632-4559-a32e-65866468e295-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "cinder-quobyte-80561d64-63d1-44ce-b0e3-84b9be64826b" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-quobyte-80561d64-63d1-44ce-b0e3-84b9be64826b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "cinder-quobyte-8e033232-4632-4559-a32e-65866468e295" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-quobyte-8e033232-4632-4559-a32e-65866468e295" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Deleting offline snapshot 8e033232-4632-4559-a32e-65866468e295 of volume 80561d64-63d1-44ce-b0e3-84b9be64826b {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:02:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] snapshot_file for this snap is: volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:02:38 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42a3364-8da1-4f6d-a4c6-c28e2d6aa64d]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:38 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 Jul 03 14:02:38 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-de093270-009b-47f9-9726-5745965ee0a1 req-499ca1ff-9535-494d-8b41-21d360b72e1f tempest-TestInstancesWithCinderVolumes-1328022136 None] Terminate volume connection completed successfully. Jul 03 14:02:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-de093270-009b-47f9-9726-5745965ee0a1 req-499ca1ff-9535-494d-8b41-21d360b72e1f tempest-TestInstancesWithCinderVolumes-1328022136 None] Deleting attachment 7b360541-fb19-445e-a081-9a19109ba0b1. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:02:39 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295" returned: 0 in 0.795s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80561d64-63d1-44ce-b0e3-84b9be64826b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:02:39 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46672d4-9900-4f45-954f-96233e04fb55]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:39 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b Jul 03 14:02:39 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:40 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b" returned: 0 in 0.808s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:40 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 Jul 03 14:02:40 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:40 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295" returned: 0 in 0.782s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:40 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295 Jul 03 14:02:40 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:41 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b.8e033232-4632-4559-a32e-65866468e295" returned: 0 in 0.739s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-quobyte-8e033232-4632-4559-a32e-65866468e295" released by "_delete_snapshot" :: held 3.234s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-quobyte-80561d64-63d1-44ce-b0e3-84b9be64826b" released by "delete_snapshot" :: held 3.263s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:41 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Created reservations ['8d47ec7f-fa8a-474c-8357-b86902698a9c', 'd403c224-5a5c-42c8-ba22-4711c5caed3e', 'b91b8ea8-355f-4c92-8b2a-415613b7484c', '1cf9c971-463c-4469-b7cd-23430174b44e'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:41 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Delete snapshot completed successfully. Jul 03 14:02:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-03acb533-ca1e-41b0-8d9e-2ae2ea8a3cdd tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-8e033232-4632-4559-a32e-65866468e295-delete_snapshot" released by "delete_snapshot" :: held 3.441s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "cinder-1db4ece4-c772-43aa-a15e-37062480e475-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "cinder-1db4ece4-c772-43aa-a15e-37062480e475-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "cinder-quobyte-1db4ece4-c772-43aa-a15e-37062480e475" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "cinder-quobyte-1db4ece4-c772-43aa-a15e-37062480e475" acquired by "delete_volume" :: waited 0.031s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "cinder-80561d64-63d1-44ce-b0e3-84b9be64826b-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-80561d64-63d1-44ce-b0e3-84b9be64826b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:42 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[905f6b80-c9e9-4b27-980c-6b7a62676fb8]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "cinder-quobyte-80561d64-63d1-44ce-b0e3-84b9be64826b" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-quobyte-80561d64-63d1-44ce-b0e3-84b9be64826b" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:42 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85b50f9-9165-4c6c-935d-2ad16a4e1ed1]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:42 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 Jul 03 14:02:42 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:42 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b Jul 03 14:02:42 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:43 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475" returned: 0 in 0.789s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:43 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 Jul 03 14:02:43 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:43 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b" returned: 0 in 0.803s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:43 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b Jul 03 14:02:43 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:44 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475" returned: 1 in 0.813s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:44 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-80561d64-63d1-44ce-b0e3-84b9be64826b" returned: 0 in 0.705s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:44 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475 Jul 03 14:02:44 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-quobyte-80561d64-63d1-44ce-b0e3-84b9be64826b" released by "delete_volume" :: held 1.586s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Created reservations ['97f46905-a4d6-4a43-9378-08dbb3a7844f', '4063fc10-ff54-4705-85ff-90bcd6234c36', 'a47d3e46-db5e-4a8d-9a19-4e2488d5cd69', '0470d3d6-48cc-49fc-878b-537a07c36d90'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:44 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:02:44 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "cinder-64fe2d77-eee0-466a-80be-12fa92765c46-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-64fe2d77-eee0-466a-80be-12fa92765c46-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "cinder-quobyte-64fe2d77-eee0-466a-80be-12fa92765c46" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:02:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-quobyte-64fe2d77-eee0-466a-80be-12fa92765c46" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:02:45 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-1db4ece4-c772-43aa-a15e-37062480e475" returned: 0 in 0.730s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "cinder-quobyte-1db4ece4-c772-43aa-a15e-37062480e475" released by "delete_volume" :: held 2.411s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1b3b8d-29a0-4ab0-8325-b52f50110ecf]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:45 devstack cinder-volume[86729]: WARNING cinder.quota [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1503938596-53270181 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1503938596-53270181, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:02:45 devstack cinder-volume[86729]: WARNING cinder.quota [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1503938596-53270181 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1503938596-53270181, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Created reservations ['0954c86b-4a4e-4b61-bdeb-6c158c999539', 'cb08078f-4083-4290-abfd-ab1d2287cd12', 'a7caf176-1c1c-409c-81e7-3e570f0992a2', 'f7f32944-b313-438c-b378-8a748b435f9c'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:45 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46 Jul 03 14:02:45 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:45 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:02:45 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:45 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.802s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:45 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Deleted volume successfully. Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f6fc0ce7-5bd1-4650-97d9-84978da7ad9b tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-80561d64-63d1-44ce-b0e3-84b9be64826b-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:45 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.788s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:45 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:45 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Deleted volume successfully. Jul 03 14:02:46 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0f2d29ad-5b46-482d-852f-5c0ca197a325 tempest-TestInstancesWithCinderVolumes-1328022136 None] Lock "cinder-1db4ece4-c772-43aa-a15e-37062480e475-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46" returned: 0 in 0.988s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:46 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46 Jul 03 14:02:46 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:46 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-64fe2d77-eee0-466a-80be-12fa92765c46" returned: 0 in 0.730s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-quobyte-64fe2d77-eee0-466a-80be-12fa92765c46" released by "delete_volume" :: held 1.779s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:46 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Created reservations ['fe3a98ed-c50a-452b-ab9d-e4719f5db175', '639c9d82-d105-4ade-89de-44fea03d4d97', '2398459d-14c5-4845-9380-5937a072a2e7', '3d2e633f-8e57-4e7f-874e-21c670c5a5c4'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:02:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:47 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:02:47 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:47 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.771s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:47 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:02:47 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Deleted volume successfully. Jul 03 14:02:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-345267ac-4416-4942-888b-13aa6bcb88fd tempest-SnapshotDependencyTests-273318636 None] Lock "cinder-64fe2d77-eee0-466a-80be-12fa92765c46-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=70,cinder:UPDATE=95,cinder:DELETE=7,cinder:INSERT=22 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Flow 'volume_create_manager' (b3f51ade-ff2f-459c-a4e9-6fa0b1f0a188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7980b0a-8b3e-4bd9-bd74-372d576998a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7980b0a-8b3e-4bd9-bd74-372d576998a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-545767948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1731bb-ce91-4130-b908-e928d31cbdb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e2036ff008460ea99a977955951510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:50Z,use_quota=True,user_id='c8179594f4dd4a80bbc9f1a0932d3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00a8c71-52d4-4d53-af63-bad9279312fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00a8c71-52d4-4d53-af63-bad9279312fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d925c6-c972-403c-a6b2-a45da7327d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d925c6-c972-403c-a6b2-a45da7327d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc1731bb-ce91-4130-b908-e928d31cbdb7', 'volume_name': 'volume-fc1731bb-ce91-4130-b908-e928d31cbdb7', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec2cc59-f4be-4835-96ef-6525ce47d6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec2cc59-f4be-4835-96ef-6525ce47d6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4dfe0c-9d5b-4403-9205-0d3fb8e90b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:50 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Volume fc1731bb-ce91-4130-b908-e928d31cbdb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc1731bb-ce91-4130-b908-e928d31cbdb7', 'volume_size': 1} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-545767948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1731bb-ce91-4130-b908-e928d31cbdb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e2036ff008460ea99a977955951510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:50Z,use_quota=True,user_id='c8179594f4dd4a80bbc9f1a0932d3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Creating volume fc1731bb-ce91-4130-b908-e928d31cbdb7 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:50 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:02:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fc1731bb-ce91-4130-b908-e928d31cbdb7 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:50 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fc1731bb-ce91-4130-b908-e928d31cbdb7 1073741824 Jul 03 14:02:50 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:51 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fc1731bb-ce91-4130-b908-e928d31cbdb7 1073741824" returned: 0 in 0.972s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:51 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=80,cinder:UPDATE=83,cinder:INSERT=19,cinder:DELETE=7 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:02:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fc1731bb-ce91-4130-b908-e928d31cbdb7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:51 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fc1731bb-ce91-4130-b908-e928d31cbdb7 Jul 03 14:02:51 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:52 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fc1731bb-ce91-4130-b908-e928d31cbdb7" returned: 0 in 0.839s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:52 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4dfe0c-9d5b-4403-9205-0d3fb8e90b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc1731bb-ce91-4130-b908-e928d31cbdb7', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafa448b-eeef-4fa3-a8c8-35b74639bb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:52 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Volume volume-fc1731bb-ce91-4130-b908-e928d31cbdb7 (fc1731bb-ce91-4130-b908-e928d31cbdb7): created successfully Jul 03 14:02:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafa448b-eeef-4fa3-a8c8-35b74639bb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Flow 'volume_create_manager' (b3f51ade-ff2f-459c-a4e9-6fa0b1f0a188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:52 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-cb9ba8f2-9a0c-4e60-aa38-b21f89e901e2 tempest-VolumesListAdminTestJSON-581697326 None] Created volume successfully. Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Flow 'volume_create_manager' (27a59c7b-d18d-48b7-baf1-09b364fa1ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4a3888-e0df-454d-9cad-d4f7a8b56600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4a3888-e0df-454d-9cad-d4f7a8b56600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1298504826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626d0837-724b-409f-aad8-9051d5e1fab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e2036ff008460ea99a977955951510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:54Z,use_quota=True,user_id='c8179594f4dd4a80bbc9f1a0932d3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d79d2a-fc51-42a6-ae61-31d957f384f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d79d2a-fc51-42a6-ae61-31d957f384f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8aa756-4c7a-4a3d-80c1-4ff7f9f3cff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8aa756-4c7a-4a3d-80c1-4ff7f9f3cff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626d0837-724b-409f-aad8-9051d5e1fab1', 'volume_name': 'volume-626d0837-724b-409f-aad8-9051d5e1fab1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9147d399-d477-4d25-a4d0-626178b79edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9147d399-d477-4d25-a4d0-626178b79edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382d1f59-36df-4c1f-8ed7-cbb7df926c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:53 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Volume 626d0837-724b-409f-aad8-9051d5e1fab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626d0837-724b-409f-aad8-9051d5e1fab1', 'volume_size': 1} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1298504826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626d0837-724b-409f-aad8-9051d5e1fab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e2036ff008460ea99a977955951510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:54Z,use_quota=True,user_id='c8179594f4dd4a80bbc9f1a0932d3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Creating volume 626d0837-724b-409f-aad8-9051d5e1fab1 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:54 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:02:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-626d0837-724b-409f-aad8-9051d5e1fab1 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:54 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-626d0837-724b-409f-aad8-9051d5e1fab1 1073741824 Jul 03 14:02:54 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:55 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-626d0837-724b-409f-aad8-9051d5e1fab1 1073741824" returned: 0 in 1.041s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-626d0837-724b-409f-aad8-9051d5e1fab1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:55 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-626d0837-724b-409f-aad8-9051d5e1fab1 Jul 03 14:02:55 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:56 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-626d0837-724b-409f-aad8-9051d5e1fab1" returned: 0 in 0.959s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382d1f59-36df-4c1f-8ed7-cbb7df926c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626d0837-724b-409f-aad8-9051d5e1fab1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390d8782-e523-4379-86a1-94dc1de3ce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:56 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Volume volume-626d0837-724b-409f-aad8-9051d5e1fab1 (626d0837-724b-409f-aad8-9051d5e1fab1): created successfully Jul 03 14:02:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390d8782-e523-4379-86a1-94dc1de3ce9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Flow 'volume_create_manager' (27a59c7b-d18d-48b7-baf1-09b364fa1ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:56 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-87c6705f-02ee-4b7a-be5f-21f9844e6aa1 tempest-VolumesListAdminTestJSON-581697326 None] Created volume successfully. Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Flow 'volume_create_manager' (2c676aa9-7f11-45ae-9f0b-e65c736b499e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dde18e8-76df-4201-b395-bc4bca2a102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dde18e8-76df-4201-b395-bc4bca2a102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-538591671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcaddaf-295a-4b91-b7f9-11366f6165f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e2036ff008460ea99a977955951510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:58Z,use_quota=True,user_id='c8179594f4dd4a80bbc9f1a0932d3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c011fe71-84bd-43a0-a838-e7cce92df671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c011fe71-84bd-43a0-a838-e7cce92df671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d958349-c0fb-4b80-8d3b-b9b4a5dfa5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d958349-c0fb-4b80-8d3b-b9b4a5dfa5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bcaddaf-295a-4b91-b7f9-11366f6165f6', 'volume_name': 'volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e099a517-ff44-4869-be7b-1f25d8f760ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e099a517-ff44-4869-be7b-1f25d8f760ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072354a7-0e10-4fb4-a7c0-f75fc7926f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:57 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Volume 8bcaddaf-295a-4b91-b7f9-11366f6165f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6', 'volume_size': 1} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-538591671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcaddaf-295a-4b91-b7f9-11366f6165f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e2036ff008460ea99a977955951510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:02:58Z,use_quota=True,user_id='c8179594f4dd4a80bbc9f1a0932d3fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Creating volume 8bcaddaf-295a-4b91-b7f9-11366f6165f6 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:02:57 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:02:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:57 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6 1073741824 Jul 03 14:02:57 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:58 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6 1073741824" returned: 0 in 1.046s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:02:58 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6 Jul 03 14:02:58 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:02:59 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Jul 03 14:02:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6" returned: 0 in 0.688s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:02:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:02:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:02:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072354a7-0e10-4fb4-a7c0-f75fc7926f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebe335a-acba-4811-b163-68986844b2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:02:59 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Volume volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6 (8bcaddaf-295a-4b91-b7f9-11366f6165f6): created successfully Jul 03 14:02:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebe335a-acba-4811-b163-68986844b2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:02:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Flow 'volume_create_manager' (2c676aa9-7f11-45ae-9f0b-e65c736b499e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:02:59 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-738511e8-fd0d-4536-9cd6-774b840cbdc0 tempest-VolumesListAdminTestJSON-581697326 None] Created volume successfully. Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Flow 'volume_create_manager' (6683e4ee-8b42-4b52-a407-684e755e1349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0909f3-b7b4-4823-bc1a-5bb841da480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0909f3-b7b4-4823-bc1a-5bb841da480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ea29f5-e2fb-4e13-8093-325a811314e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceb226b9dc96436696f21629033f22c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:00Z,use_quota=True,user_id='c04ed16d5d7b429ca2d5a13b0a475f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582f888d-bb16-452b-9c9c-0fff7b0554bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582f888d-bb16-452b-9c9c-0fff7b0554bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8288778f-ec8d-4662-a2a2-feb1a2d44c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8288778f-ec8d-4662-a2a2-feb1a2d44c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ea29f5-e2fb-4e13-8093-325a811314e6', 'volume_name': 'volume-04ea29f5-e2fb-4e13-8093-325a811314e6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958cd5c6-6837-420b-92ef-5f0969fbf051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958cd5c6-6837-420b-92ef-5f0969fbf051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f478c87e-ebbb-42fe-9e9b-5ab889db13bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:00 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Volume 04ea29f5-e2fb-4e13-8093-325a811314e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ea29f5-e2fb-4e13-8093-325a811314e6', 'volume_size': 1} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ea29f5-e2fb-4e13-8093-325a811314e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceb226b9dc96436696f21629033f22c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:00Z,use_quota=True,user_id='c04ed16d5d7b429ca2d5a13b0a475f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Creating volume 04ea29f5-e2fb-4e13-8093-325a811314e6 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:00 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:03:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-04ea29f5-e2fb-4e13-8093-325a811314e6 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:00 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-04ea29f5-e2fb-4e13-8093-325a811314e6 1073741824 Jul 03 14:03:00 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:01 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-04ea29f5-e2fb-4e13-8093-325a811314e6 1073741824" returned: 0 in 0.877s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-04ea29f5-e2fb-4e13-8093-325a811314e6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:01 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-04ea29f5-e2fb-4e13-8093-325a811314e6 Jul 03 14:03:01 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:02 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-04ea29f5-e2fb-4e13-8093-325a811314e6" returned: 0 in 0.672s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f478c87e-ebbb-42fe-9e9b-5ab889db13bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ea29f5-e2fb-4e13-8093-325a811314e6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b766a5-f8f9-4f6d-8b7b-3dae678fe625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:02 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Volume volume-04ea29f5-e2fb-4e13-8093-325a811314e6 (04ea29f5-e2fb-4e13-8093-325a811314e6): created successfully Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b766a5-f8f9-4f6d-8b7b-3dae678fe625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Flow 'volume_create_manager' (6683e4ee-8b42-4b52-a407-684e755e1349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:02 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-84c82e94-7492-4dbe-87a1-c48857dd3464 tempest-VolumesListAdminTestJSON-328316618 None] Created volume successfully. Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Acquiring lock "cinder-04ea29f5-e2fb-4e13-8093-325a811314e6-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Lock "cinder-04ea29f5-e2fb-4e13-8093-325a811314e6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Acquiring lock "cinder-quobyte-04ea29f5-e2fb-4e13-8093-325a811314e6" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Lock "cinder-quobyte-04ea29f5-e2fb-4e13-8093-325a811314e6" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6f9b06-556c-432f-9bb2-c359ec48ef3f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-04ea29f5-e2fb-4e13-8093-325a811314e6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "cinder-8bcaddaf-295a-4b91-b7f9-11366f6165f6-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Lock "cinder-8bcaddaf-295a-4b91-b7f9-11366f6165f6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "cinder-quobyte-8bcaddaf-295a-4b91-b7f9-11366f6165f6" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Lock "cinder-quobyte-8bcaddaf-295a-4b91-b7f9-11366f6165f6" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7df287-edd0-4353-bb92-12aa04ffd6b9]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:02 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-04ea29f5-e2fb-4e13-8093-325a811314e6 Jul 03 14:03:02 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:03 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6 Jul 03 14:03:03 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:03 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-04ea29f5-e2fb-4e13-8093-325a811314e6" returned: 0 in 0.853s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-04ea29f5-e2fb-4e13-8093-325a811314e6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:03 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-04ea29f5-e2fb-4e13-8093-325a811314e6 Jul 03 14:03:03 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:03 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6" returned: 0 in 0.853s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:03 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6 Jul 03 14:03:03 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:04 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-04ea29f5-e2fb-4e13-8093-325a811314e6" returned: 0 in 0.821s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Lock "cinder-quobyte-04ea29f5-e2fb-4e13-8093-325a811314e6" released by "delete_volume" :: held 1.736s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Created reservations ['a193875b-2d8a-4f24-bfa2-57868b173334', 'ebb8f04b-167d-48b6-8f4a-2cb3dab40bb2', '273facb7-19e7-4738-bce1-68d5d58e86a1', 'f8794ed0-0c66-43be-97a4-42dd9448a947'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:04 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:04 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8bcaddaf-295a-4b91-b7f9-11366f6165f6" returned: 0 in 0.907s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:04 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Lock "cinder-quobyte-8bcaddaf-295a-4b91-b7f9-11366f6165f6" released by "delete_volume" :: held 1.820s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Created reservations ['70d82441-419e-4491-bf17-32c9ae68f6b7', '980781ee-0b02-4a5a-a5dd-b164625ee44a', 'dd909e7d-ba0f-4b9d-8556-e06485908ea5', 'cfea39e2-2092-43bc-ba9b-3d5527568c4a'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:04 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:03:04 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "cinder-626d0837-724b-409f-aad8-9051d5e1fab1-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Lock "cinder-626d0837-724b-409f-aad8-9051d5e1fab1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "cinder-quobyte-626d0837-724b-409f-aad8-9051d5e1fab1" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Lock "cinder-quobyte-626d0837-724b-409f-aad8-9051d5e1fab1" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:05 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f30999-a772-45e9-824e-27d8d1c43d45]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-626d0837-724b-409f-aad8-9051d5e1fab1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:05 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-626d0837-724b-409f-aad8-9051d5e1fab1 Jul 03 14:03:05 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.834s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:05 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:05 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Deleted volume successfully. Jul 03 14:03:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-bdb4fe88-0468-432d-a3c3-690dde716558 tempest-VolumesListAdminTestJSON-328316618 None] Lock "cinder-04ea29f5-e2fb-4e13-8093-325a811314e6-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:05 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.791s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:05 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Deleted volume successfully. Jul 03 14:03:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f7969d8f-f7c7-4e21-878a-50b729a5b7c8 tempest-VolumesListAdminTestJSON-581697326 None] Lock "cinder-8bcaddaf-295a-4b91-b7f9-11366f6165f6-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:06 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-626d0837-724b-409f-aad8-9051d5e1fab1" returned: 0 in 0.882s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-626d0837-724b-409f-aad8-9051d5e1fab1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:06 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-626d0837-724b-409f-aad8-9051d5e1fab1 Jul 03 14:03:06 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:06 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-626d0837-724b-409f-aad8-9051d5e1fab1" returned: 0 in 0.740s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Lock "cinder-quobyte-626d0837-724b-409f-aad8-9051d5e1fab1" released by "delete_volume" :: held 1.683s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:06 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Created reservations ['e4d10c62-915a-4286-a711-ccd4800244d4', 'e7c1baf3-8e4f-4594-bf60-491ed7c83257', '695e223b-5a43-4914-9b11-75ba051fd97a', 'a330a8e7-4cba-4aad-ba41-d60516fc40f4'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:07 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:03:07 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "cinder-fc1731bb-ce91-4130-b908-e928d31cbdb7-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Lock "cinder-fc1731bb-ce91-4130-b908-e928d31cbdb7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "cinder-quobyte-fc1731bb-ce91-4130-b908-e928d31cbdb7" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Lock "cinder-quobyte-fc1731bb-ce91-4130-b908-e928d31cbdb7" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab8f177-5563-4d07-be0b-42b68b9e32a3]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fc1731bb-ce91-4130-b908-e928d31cbdb7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:07 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fc1731bb-ce91-4130-b908-e928d31cbdb7 Jul 03 14:03:07 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:07 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.707s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:07 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Deleted volume successfully. Jul 03 14:03:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6f6a1a66-dc01-452c-875d-413c488552a7 tempest-VolumesListAdminTestJSON-581697326 None] Lock "cinder-626d0837-724b-409f-aad8-9051d5e1fab1-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:08 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fc1731bb-ce91-4130-b908-e928d31cbdb7" returned: 0 in 0.865s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fc1731bb-ce91-4130-b908-e928d31cbdb7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:08 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fc1731bb-ce91-4130-b908-e928d31cbdb7 Jul 03 14:03:08 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:09 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fc1731bb-ce91-4130-b908-e928d31cbdb7" returned: 0 in 0.752s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Lock "cinder-quobyte-fc1731bb-ce91-4130-b908-e928d31cbdb7" released by "delete_volume" :: held 1.683s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:09 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Created reservations ['fae09f99-876a-45b8-91df-b2226fcd746c', '26cab65f-9e30-424a-a774-4b6b75c168ec', '0d973138-b70b-4954-b7d9-1e75ae93ba88', '19b752bb-a2aa-48b5-b57d-baceed808648'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:09 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:03:09 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:10 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.693s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:10 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:10 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Deleted volume successfully. Jul 03 14:03:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4d3b919a-1cd9-41ec-a7cd-172faef4c8b2 tempest-VolumesListAdminTestJSON-581697326 None] Lock "cinder-fc1731bb-ce91-4130-b908-e928d31cbdb7-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:19 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=42,cinder:DELETE=5,cinder:SELECT=25,cinder:INSERT=7 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:03:20 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=29,cinder:INSERT=13,cinder:UPDATE=44,cinder:DELETE=3 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Flow 'volume_create_manager' (a7824c8e-c1a8-4fb9-9c64-454256f4f633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f667d7f3-648f-440a-ac18-1112e557b31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f667d7f3-648f-440a-ac18-1112e557b31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-403550749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b77867-72ff-4ba1-abd4-1bdfd74ea946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f92c58d9b74b34ad0b4f944a165755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:21Z,use_quota=True,user_id='4ebf5be56c7d411384d647b310b6412a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4644585d-99ef-42b6-bfd3-f77abef6d07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4644585d-99ef-42b6-bfd3-f77abef6d07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ecab51-9f80-47ad-b787-c59f08e7d191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ecab51-9f80-47ad-b787-c59f08e7d191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b77867-72ff-4ba1-abd4-1bdfd74ea946', 'volume_name': 'volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20a6d66-c8f0-48b4-9dcb-84894f727d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20a6d66-c8f0-48b4-9dcb-84894f727d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4281e533-010f-4660-92ac-6654e76b822e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:21 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Volume 89b77867-72ff-4ba1-abd4-1bdfd74ea946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946', 'volume_size': 1} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-403550749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b77867-72ff-4ba1-abd4-1bdfd74ea946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f92c58d9b74b34ad0b4f944a165755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:21Z,use_quota=True,user_id='4ebf5be56c7d411384d647b310b6412a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Creating volume 89b77867-72ff-4ba1-abd4-1bdfd74ea946 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:21 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:21 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946 1073741824 Jul 03 14:03:21 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:21 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946 1073741824" returned: 0 in 0.860s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:22 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946 Jul 03 14:03:22 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:22 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946" returned: 0 in 0.685s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4281e533-010f-4660-92ac-6654e76b822e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505ee02a-a130-4d9b-b299-d98ce6c36e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:22 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Volume volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946 (89b77867-72ff-4ba1-abd4-1bdfd74ea946): created successfully Jul 03 14:03:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505ee02a-a130-4d9b-b299-d98ce6c36e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Flow 'volume_create_manager' (a7824c8e-c1a8-4fb9-9c64-454256f4f633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:22 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-14bbbea2-5f7a-4dfc-a07e-dae4dd1131b3 tempest-AbsoluteLimitsTests-305688310 None] Created volume successfully. Jul 03 14:03:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Acquiring lock "cinder-89b77867-72ff-4ba1-abd4-1bdfd74ea946-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Lock "cinder-89b77867-72ff-4ba1-abd4-1bdfd74ea946-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Acquiring lock "cinder-quobyte-89b77867-72ff-4ba1-abd4-1bdfd74ea946" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Lock "cinder-quobyte-89b77867-72ff-4ba1-abd4-1bdfd74ea946" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe2cacc-90f5-4917-89dd-3f95897b4fc7]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:23 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946 Jul 03 14:03:23 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:24 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946" returned: 0 in 0.774s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:24 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946 Jul 03 14:03:24 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:24 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-89b77867-72ff-4ba1-abd4-1bdfd74ea946" returned: 0 in 0.657s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:24 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Lock "cinder-quobyte-89b77867-72ff-4ba1-abd4-1bdfd74ea946" released by "delete_volume" :: held 1.473s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:24 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Created reservations ['b11621e3-3093-42f6-bc47-571a27222e53', '68775c0d-da5a-4959-bf49-f66b44df2b78', '286d2369-d1c5-498e-90c4-4e46736bc245', '55a49bbb-c1e3-4382-b20f-37b85901662d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:24 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:03:24 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:25 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.672s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:25 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:25 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Deleted volume successfully. Jul 03 14:03:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e8e5360b-2b3c-4ac7-8048-fc5f3ab14046 tempest-AbsoluteLimitsTests-305688310 None] Lock "cinder-89b77867-72ff-4ba1-abd4-1bdfd74ea946-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:03:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:26 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:03:26 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:26 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.653s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Flow 'volume_create_manager' (70963587-ef94-45ba-a336-a914a1d87f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5f90ee-c5f9-4d01-a91d-de12d447d8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5f90ee-c5f9-4d01-a91d-de12d447d8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-808214082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8269232e-c436-4ddb-9dd5-77e88cc37218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870cc30125a74301b35d4650efada486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:29Z,use_quota=True,user_id='020f54535d2c49febb73a6f4641a076b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f9c1fa-6efb-410f-a23f-f0127d513f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f9c1fa-6efb-410f-a23f-f0127d513f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5daeee37-e8ab-4d3d-bd9f-6ced2a544300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5daeee37-e8ab-4d3d-bd9f-6ced2a544300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8269232e-c436-4ddb-9dd5-77e88cc37218', 'volume_name': 'volume-8269232e-c436-4ddb-9dd5-77e88cc37218', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6e4510-f0fc-4385-8deb-93d01520dc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6e4510-f0fc-4385-8deb-93d01520dc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ca5578-149c-4bf2-bd86-a37e9ac58e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:29 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Volume 8269232e-c436-4ddb-9dd5-77e88cc37218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8269232e-c436-4ddb-9dd5-77e88cc37218', 'volume_size': 1} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-808214082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8269232e-c436-4ddb-9dd5-77e88cc37218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870cc30125a74301b35d4650efada486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:29Z,use_quota=True,user_id='020f54535d2c49febb73a6f4641a076b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Creating volume 8269232e-c436-4ddb-9dd5-77e88cc37218 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:29 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:03:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8269232e-c436-4ddb-9dd5-77e88cc37218 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:29 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8269232e-c436-4ddb-9dd5-77e88cc37218 1073741824 Jul 03 14:03:29 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:30 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8269232e-c436-4ddb-9dd5-77e88cc37218 1073741824" returned: 0 in 0.940s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8269232e-c436-4ddb-9dd5-77e88cc37218 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:30 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8269232e-c436-4ddb-9dd5-77e88cc37218 Jul 03 14:03:30 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:31 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8269232e-c436-4ddb-9dd5-77e88cc37218" returned: 0 in 0.619s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ca5578-149c-4bf2-bd86-a37e9ac58e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8269232e-c436-4ddb-9dd5-77e88cc37218', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbfec4c-4c7b-478d-9cae-18d5c0e58cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:31 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Volume volume-8269232e-c436-4ddb-9dd5-77e88cc37218 (8269232e-c436-4ddb-9dd5-77e88cc37218): created successfully Jul 03 14:03:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbfec4c-4c7b-478d-9cae-18d5c0e58cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:31 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Flow 'volume_create_manager' (70963587-ef94-45ba-a336-a914a1d87f58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:31 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9bdcb975-dfbd-4ed2-99fe-87c0ba75e5b4 tempest-VolumesMetadataTest-493769377 None] Created volume successfully. Jul 03 14:03:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Acquiring lock "cinder-8269232e-c436-4ddb-9dd5-77e88cc37218-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Lock "cinder-8269232e-c436-4ddb-9dd5-77e88cc37218-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Acquiring lock "cinder-quobyte-8269232e-c436-4ddb-9dd5-77e88cc37218" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Lock "cinder-quobyte-8269232e-c436-4ddb-9dd5-77e88cc37218" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8cb03e-503c-4576-a6c3-c74fdc14c3a4]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8269232e-c436-4ddb-9dd5-77e88cc37218 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:32 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8269232e-c436-4ddb-9dd5-77e88cc37218 Jul 03 14:03:32 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:33 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8269232e-c436-4ddb-9dd5-77e88cc37218" returned: 0 in 0.772s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8269232e-c436-4ddb-9dd5-77e88cc37218 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:33 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8269232e-c436-4ddb-9dd5-77e88cc37218 Jul 03 14:03:33 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:33 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8269232e-c436-4ddb-9dd5-77e88cc37218" returned: 0 in 0.646s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Lock "cinder-quobyte-8269232e-c436-4ddb-9dd5-77e88cc37218" released by "delete_volume" :: held 1.456s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:33 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Created reservations ['87ee139c-7ff1-4311-84fc-f3ee2d49fcb3', '8184be20-53ed-4987-9645-6e29fb8d28f8', '7f5f9b28-da48-4ae7-bce7-92c0852d26c0', 'dc36fef9-cfed-4c64-b810-ebe8ccedf9a5'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:33 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:03:33 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:34 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.639s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:34 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Deleted volume successfully. Jul 03 14:03:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a8abf562-2745-40c9-b8e7-b22ed5ac533c tempest-VolumesMetadataTest-493769377 None] Lock "cinder-8269232e-c436-4ddb-9dd5-77e88cc37218-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Flow 'volume_create_manager' (512ff9a5-5cc7-45df-8ed6-54d0e4e8b392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095a9b5d-b241-464b-a2e6-e76f2b261d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095a9b5d-b241-464b-a2e6-e76f2b261d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-975147088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef5e26a-ae56-4f10-8270-c256abc86d0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe6ced7c6af7426388c0510a03f00cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:38Z,use_quota=True,user_id='29c4fdfbc2ab4d4c9ce1793b8e267016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082055d5-c0e4-48f6-b4b7-af5288dacd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082055d5-c0e4-48f6-b4b7-af5288dacd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7c9835-343b-4a46-bea6-d0110cc5ac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7c9835-343b-4a46-bea6-d0110cc5ac3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef5e26a-ae56-4f10-8270-c256abc86d0b', 'volume_name': 'volume-cef5e26a-ae56-4f10-8270-c256abc86d0b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8867e166-3a52-43df-8692-3209cb91b64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8867e166-3a52-43df-8692-3209cb91b64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b2b679-c6e7-405f-bac5-7dfb1ac8aa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:38 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Volume cef5e26a-ae56-4f10-8270-c256abc86d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef5e26a-ae56-4f10-8270-c256abc86d0b', 'volume_size': 1} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-975147088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef5e26a-ae56-4f10-8270-c256abc86d0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe6ced7c6af7426388c0510a03f00cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:38Z,use_quota=True,user_id='29c4fdfbc2ab4d4c9ce1793b8e267016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Creating volume cef5e26a-ae56-4f10-8270-c256abc86d0b {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:38 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:03:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cef5e26a-ae56-4f10-8270-c256abc86d0b 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:38 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cef5e26a-ae56-4f10-8270-c256abc86d0b 1073741824 Jul 03 14:03:38 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:39 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cef5e26a-ae56-4f10-8270-c256abc86d0b 1073741824" returned: 0 in 0.965s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cef5e26a-ae56-4f10-8270-c256abc86d0b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:39 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cef5e26a-ae56-4f10-8270-c256abc86d0b Jul 03 14:03:39 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:40 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cef5e26a-ae56-4f10-8270-c256abc86d0b" returned: 0 in 0.799s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b2b679-c6e7-405f-bac5-7dfb1ac8aa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef5e26a-ae56-4f10-8270-c256abc86d0b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e3fe98-30b6-4503-8556-4b42275a5bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:40 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Volume volume-cef5e26a-ae56-4f10-8270-c256abc86d0b (cef5e26a-ae56-4f10-8270-c256abc86d0b): created successfully Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e3fe98-30b6-4503-8556-4b42275a5bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Flow 'volume_create_manager' (512ff9a5-5cc7-45df-8ed6-54d0e4e8b392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:40 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-80b232e9-ecf5-4d4f-aff9-3c04a3c92c1c tempest-VolumesListTestJSON-870325117 None] Created volume successfully. Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Flow 'volume_create_manager' (0d55ed46-a2fe-4f24-8816-892d8a9fe575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494eecd8-6b84-4d6f-812f-29fe0085f7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494eecd8-6b84-4d6f-812f-29fe0085f7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-846339004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c55dd3-6127-41f2-a05f-3c16488d2405,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe6ced7c6af7426388c0510a03f00cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:41Z,use_quota=True,user_id='29c4fdfbc2ab4d4c9ce1793b8e267016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcb3d30-7443-4501-b1d4-f597327eac93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcb3d30-7443-4501-b1d4-f597327eac93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba03f17-ad47-4c07-804a-dd396a9fa155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba03f17-ad47-4c07-804a-dd396a9fa155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c55dd3-6127-41f2-a05f-3c16488d2405', 'volume_name': 'volume-72c55dd3-6127-41f2-a05f-3c16488d2405', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d476c6c2-580e-441a-8b7f-e01d6a77c2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d476c6c2-580e-441a-8b7f-e01d6a77c2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6073d310-d640-4724-9f2c-e711da275a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:40 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Volume 72c55dd3-6127-41f2-a05f-3c16488d2405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c55dd3-6127-41f2-a05f-3c16488d2405', 'volume_size': 1} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-846339004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c55dd3-6127-41f2-a05f-3c16488d2405,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe6ced7c6af7426388c0510a03f00cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:41Z,use_quota=True,user_id='29c4fdfbc2ab4d4c9ce1793b8e267016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Creating volume 72c55dd3-6127-41f2-a05f-3c16488d2405 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:40 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:03:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72c55dd3-6127-41f2-a05f-3c16488d2405 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:40 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72c55dd3-6127-41f2-a05f-3c16488d2405 1073741824 Jul 03 14:03:40 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:41 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72c55dd3-6127-41f2-a05f-3c16488d2405 1073741824" returned: 0 in 0.852s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72c55dd3-6127-41f2-a05f-3c16488d2405 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:41 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72c55dd3-6127-41f2-a05f-3c16488d2405 Jul 03 14:03:41 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:42 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72c55dd3-6127-41f2-a05f-3c16488d2405" returned: 0 in 0.633s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:42 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6073d310-d640-4724-9f2c-e711da275a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c55dd3-6127-41f2-a05f-3c16488d2405', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b784db3-0491-45c8-9428-4dc958f20a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:42 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Volume volume-72c55dd3-6127-41f2-a05f-3c16488d2405 (72c55dd3-6127-41f2-a05f-3c16488d2405): created successfully Jul 03 14:03:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b784db3-0491-45c8-9428-4dc958f20a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Flow 'volume_create_manager' (0d55ed46-a2fe-4f24-8816-892d8a9fe575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:42 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-dfe6353c-aa0c-446e-aa3e-eee59a5edd5d tempest-VolumesListTestJSON-870325117 None] Created volume successfully. Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Flow 'volume_create_manager' (a068e26c-70cc-4803-8b87-013ccb4a9376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dee9b1-47da-4aad-9ad6-d715ffbd2496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dee9b1-47da-4aad-9ad6-d715ffbd2496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-692056167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe6ced7c6af7426388c0510a03f00cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:43Z,use_quota=True,user_id='29c4fdfbc2ab4d4c9ce1793b8e267016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e17fd1-265c-45fb-9cf7-c21bdd773ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e17fd1-265c-45fb-9cf7-c21bdd773ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97477dd-b69f-42d5-9618-86cb4c5b3203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97477dd-b69f-42d5-9618-86cb4c5b3203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2', 'volume_name': 'volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a775005-d72b-4184-9ab3-07995038af9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a775005-d72b-4184-9ab3-07995038af9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26079a89-3fa9-4ee9-803f-cc156b82674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:43 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Volume 5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2', 'volume_size': 1} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-692056167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fe6ced7c6af7426388c0510a03f00cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:43Z,use_quota=True,user_id='29c4fdfbc2ab4d4c9ce1793b8e267016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Creating volume 5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:43 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:03:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:43 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2 1073741824 Jul 03 14:03:43 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:44 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2 1073741824" returned: 0 in 0.814s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:44 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2 Jul 03 14:03:44 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:44 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2" returned: 0 in 0.632s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26079a89-3fa9-4ee9-803f-cc156b82674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0ec993-b2a7-4968-af3d-aa94acb200cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:45 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Volume volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2 (5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2): created successfully Jul 03 14:03:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0ec993-b2a7-4968-af3d-aa94acb200cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Flow 'volume_create_manager' (a068e26c-70cc-4803-8b87-013ccb4a9376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:45 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-0941ba95-cb60-40fc-9385-5d32bdf50121 tempest-VolumesListTestJSON-870325117 None] Created volume successfully. Jul 03 14:03:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Acquiring lock "cinder-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Lock "cinder-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Acquiring lock "cinder-quobyte-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Lock "cinder-quobyte-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bedbf10-4738-4af0-a0f9-36b7b4458f73]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:48 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2 Jul 03 14:03:48 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:48 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2" returned: 0 in 0.746s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:48 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2 Jul 03 14:03:48 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:49 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2" returned: 0 in 0.612s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Lock "cinder-quobyte-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2" released by "delete_volume" :: held 1.400s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:49 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Created reservations ['8bde7a0e-a5d3-46e8-aba6-0849ec8cba90', 'dd95b246-5b11-49c2-b2cc-65d85b56e5a5', '2db4074b-e695-4b1c-9562-1c4a36950d3c', 'd5598601-573e-449b-b2d3-4095525aa46d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:49 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:03:49 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:50 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Acquiring lock "cinder-72c55dd3-6127-41f2-a05f-3c16488d2405-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.662s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:50 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Deleted volume successfully. Jul 03 14:03:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Lock "cinder-72c55dd3-6127-41f2-a05f-3c16488d2405-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b3678804-b194-4850-b77d-de8ddbe370a8 tempest-VolumesListTestJSON-870325117 None] Lock "cinder-5ef86c7f-9ab1-42f1-9113-dc7b49c68dc2-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Acquiring lock "cinder-quobyte-72c55dd3-6127-41f2-a05f-3c16488d2405" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Lock "cinder-quobyte-72c55dd3-6127-41f2-a05f-3c16488d2405" acquired by "delete_volume" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:50 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f814271d-771c-4663-8b80-bfbcd5563942]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72c55dd3-6127-41f2-a05f-3c16488d2405 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:50 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72c55dd3-6127-41f2-a05f-3c16488d2405 Jul 03 14:03:50 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:50 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72c55dd3-6127-41f2-a05f-3c16488d2405" returned: 0 in 0.721s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72c55dd3-6127-41f2-a05f-3c16488d2405 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:50 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72c55dd3-6127-41f2-a05f-3c16488d2405 Jul 03 14:03:50 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:51 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-72c55dd3-6127-41f2-a05f-3c16488d2405" returned: 0 in 0.607s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Lock "cinder-quobyte-72c55dd3-6127-41f2-a05f-3c16488d2405" released by "delete_volume" :: held 1.366s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:51 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Created reservations ['a5fa56d1-30e4-4d94-ae50-67c2940a3de5', '0841e60a-9a8e-4cf6-ae06-93cdaa070ade', 'a87b5ae1-e657-4639-9b9e-1a46b693c15d', 'ac44647f-905f-468f-9d52-9bc910c40a41'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:51 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:03:51 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:52 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.644s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:52 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:52 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Deleted volume successfully. Jul 03 14:03:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f9c484b8-9e74-4faa-b39e-e271eb2ef7cc tempest-VolumesListTestJSON-870325117 None] Lock "cinder-72c55dd3-6127-41f2-a05f-3c16488d2405-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Acquiring lock "cinder-cef5e26a-ae56-4f10-8270-c256abc86d0b-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Lock "cinder-cef5e26a-ae56-4f10-8270-c256abc86d0b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Acquiring lock "cinder-quobyte-cef5e26a-ae56-4f10-8270-c256abc86d0b" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:03:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Lock "cinder-quobyte-cef5e26a-ae56-4f10-8270-c256abc86d0b" acquired by "delete_volume" :: waited 0.013s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:03:52 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5580cd10-d194-4767-8966-5ea08ef31549]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:03:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cef5e26a-ae56-4f10-8270-c256abc86d0b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:52 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cef5e26a-ae56-4f10-8270-c256abc86d0b Jul 03 14:03:52 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:53 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cef5e26a-ae56-4f10-8270-c256abc86d0b" returned: 0 in 0.751s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cef5e26a-ae56-4f10-8270-c256abc86d0b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:53 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cef5e26a-ae56-4f10-8270-c256abc86d0b Jul 03 14:03:53 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:53 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cef5e26a-ae56-4f10-8270-c256abc86d0b" returned: 0 in 0.672s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Lock "cinder-quobyte-cef5e26a-ae56-4f10-8270-c256abc86d0b" released by "delete_volume" :: held 1.460s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:53 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Created reservations ['cc43c207-781a-4d10-84fe-04707f72646f', 'defd81bc-078d-49be-b2b8-ace1ff6c2040', '5eb75c28-ce6a-48b5-84ea-05b08021da6b', 'bb832e3a-a2c6-46a9-92c6-a61400428db8'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:03:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:54 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:03:54 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:54 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.640s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:54 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:03:54 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Deleted volume successfully. Jul 03 14:03:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c2c2b3e-7fbe-43ad-bc41-6092479a184c tempest-VolumesListTestJSON-870325117 None] Lock "cinder-cef5e26a-ae56-4f10-8270-c256abc86d0b-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Flow 'volume_create_manager' (dad28b12-5345-4845-852a-667af810b465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de758d3-4799-4b6e-925e-f9f36eceb072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de758d3-4799-4b6e-925e-f9f36eceb072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1774518890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f70b4d6-65af-4730-9ebb-64573eb9367b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67889853c92642b298045defb8ef2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:57Z,use_quota=True,user_id='f59fe62d0b0b4e03b8456d515068f2bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb3c7e2-b49c-494a-9775-10ac27e477c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb3c7e2-b49c-494a-9775-10ac27e477c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93437998-924d-4780-a418-c3ac28414702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93437998-924d-4780-a418-c3ac28414702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f70b4d6-65af-4730-9ebb-64573eb9367b', 'volume_name': 'volume-8f70b4d6-65af-4730-9ebb-64573eb9367b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4ba230-d045-42f8-af8e-6c99b1908a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4ba230-d045-42f8-af8e-6c99b1908a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a029e0a-12ce-47c6-8b22-be5eee2593a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:57 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Volume 8f70b4d6-65af-4730-9ebb-64573eb9367b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f70b4d6-65af-4730-9ebb-64573eb9367b', 'volume_size': 1} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1774518890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f70b4d6-65af-4730-9ebb-64573eb9367b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67889853c92642b298045defb8ef2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:03:57Z,use_quota=True,user_id='f59fe62d0b0b4e03b8456d515068f2bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Creating volume 8f70b4d6-65af-4730-9ebb-64573eb9367b {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:03:57 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:03:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8f70b4d6-65af-4730-9ebb-64573eb9367b 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:57 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8f70b4d6-65af-4730-9ebb-64573eb9367b 1073741824 Jul 03 14:03:57 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:58 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8f70b4d6-65af-4730-9ebb-64573eb9367b 1073741824" returned: 0 in 0.816s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8f70b4d6-65af-4730-9ebb-64573eb9367b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:03:58 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8f70b4d6-65af-4730-9ebb-64573eb9367b Jul 03 14:03:58 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:03:58 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jul 03 14:03:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8f70b4d6-65af-4730-9ebb-64573eb9367b" returned: 0 in 0.636s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:03:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:03:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:03:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a029e0a-12ce-47c6-8b22-be5eee2593a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f70b4d6-65af-4730-9ebb-64573eb9367b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339319a1-a740-44bc-a81f-7740a8778a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:03:58 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Volume volume-8f70b4d6-65af-4730-9ebb-64573eb9367b (8f70b4d6-65af-4730-9ebb-64573eb9367b): created successfully Jul 03 14:03:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339319a1-a740-44bc-a81f-7740a8778a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:03:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Flow 'volume_create_manager' (dad28b12-5345-4845-852a-667af810b465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:03:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e3fb7a23-2a8e-4029-9df6-09c278cd4fc3 tempest-VolumesNegativeTest-246303862 None] Created volume successfully. Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Flow 'volume_create_manager' (d099c1c3-d657-4139-a562-ae69cf16a235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d10b56d-2c54-4fdf-b704-496978bff236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d10b56d-2c54-4fdf-b704-496978bff236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2053862997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae62e97-f8c6-497e-aed5-49f3f314c9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595140148964472e9c8ff2464834662e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:00Z,use_quota=True,user_id='890d6bdc87f942e0a2d751928e80ef7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecd884e-8c57-4da7-892b-864b576c1ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecd884e-8c57-4da7-892b-864b576c1ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ff8e03-88a9-4980-aed2-ac8695e1e762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ff8e03-88a9-4980-aed2-ac8695e1e762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae62e97-f8c6-497e-aed5-49f3f314c9f9', 'volume_name': 'volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4789aae2-968a-440b-9f0d-e0b90ee1c9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4789aae2-968a-440b-9f0d-e0b90ee1c9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1e8f75-d839-45ed-abdf-024cfa31e965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:00 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Volume 5ae62e97-f8c6-497e-aed5-49f3f314c9f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9', 'volume_size': 1} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2053862997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae62e97-f8c6-497e-aed5-49f3f314c9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595140148964472e9c8ff2464834662e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:04:00Z,use_quota=True,user_id='890d6bdc87f942e0a2d751928e80ef7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Creating volume 5ae62e97-f8c6-497e-aed5-49f3f314c9f9 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:04:00 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:04:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:00 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9 1073741824 Jul 03 14:04:00 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:01 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9 1073741824" returned: 0 in 0.821s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:01 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9 Jul 03 14:04:01 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:02 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9" returned: 0 in 0.635s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:04:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1e8f75-d839-45ed-abdf-024cfa31e965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d900e4b6-0c2b-42e6-887e-7782772df34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:04:02 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Volume volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9 (5ae62e97-f8c6-497e-aed5-49f3f314c9f9): created successfully Jul 03 14:04:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d900e4b6-0c2b-42e6-887e-7782772df34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:04:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Flow 'volume_create_manager' (d099c1c3-d657-4139-a562-ae69cf16a235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:04:02 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-85e88192-0635-492a-a04e-ca3ac3630cd8 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Created volume successfully. Jul 03 14:04:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-58afd23e-7f30-4d8c-b3e6-3207e79f776b req-a430e4d0-c6bf-47a5-90d9-5d876587f79d tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-58afd23e-7f30-4d8c-b3e6-3207e79f776b req-a430e4d0-c6bf-47a5-90d9-5d876587f79d tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:05 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b015d07e-f808-487a-bed0-27037aad1c3e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-58afd23e-7f30-4d8c-b3e6-3207e79f776b req-a430e4d0-c6bf-47a5-90d9-5d876587f79d tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:05 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9 Jul 03 14:04:05 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:06 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-58afd23e-7f30-4d8c-b3e6-3207e79f776b req-a430e4d0-c6bf-47a5-90d9-5d876587f79d tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9" returned: 0 in 0.811s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-58afd23e-7f30-4d8c-b3e6-3207e79f776b req-a430e4d0-c6bf-47a5-90d9-5d876587f79d tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.838s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-58afd23e-7f30-4d8c-b3e6-3207e79f776b req-a430e4d0-c6bf-47a5-90d9-5d876587f79d tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca1e8cc1-a8eb-47ae-b113-46cc7ae1e984', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:04:06 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-58afd23e-7f30-4d8c-b3e6-3207e79f776b req-a430e4d0-c6bf-47a5-90d9-5d876587f79d tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] attachment_update completed successfully. Jul 03 14:04:15 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-15d86d59-f30b-4c10-af78-12d1cbb66d77 req-0585cdc6-a440-4960-9600-4ffc485145f7 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Terminate volume connection completed successfully. Jul 03 14:04:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-15d86d59-f30b-4c10-af78-12d1cbb66d77 req-0585cdc6-a440-4960-9600-4ffc485145f7 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Deleting attachment ca1e8cc1-a8eb-47ae-b113-46cc7ae1e984. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:04:16 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=46,cinder:UPDATE=61,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:04:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Acquiring lock "cinder-5ae62e97-f8c6-497e-aed5-49f3f314c9f9-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Lock "cinder-5ae62e97-f8c6-497e-aed5-49f3f314c9f9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Acquiring lock "cinder-quobyte-5ae62e97-f8c6-497e-aed5-49f3f314c9f9" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Lock "cinder-quobyte-5ae62e97-f8c6-497e-aed5-49f3f314c9f9" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:17 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f60c73-d831-49dd-aaba-441fffe861b8]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:17 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9 Jul 03 14:04:17 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:18 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9" returned: 0 in 0.814s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:18 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9 Jul 03 14:04:18 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:19 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-5ae62e97-f8c6-497e-aed5-49f3f314c9f9" returned: 0 in 0.631s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Lock "cinder-quobyte-5ae62e97-f8c6-497e-aed5-49f3f314c9f9" released by "delete_volume" :: held 1.495s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Created reservations ['94d6933a-da8f-486a-8435-d822aa59d0a1', 'b0302833-67a6-4f52-a82b-5a2c79333adc', '8c6119b3-8c86-403f-9f01-b6460f3d178b', '4db4354c-cb2d-43ce-91a3-2981907ef6ce'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:19 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:04:19 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:19 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.647s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:04:19 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Deleted volume successfully. Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=50,cinder:UPDATE=73,cinder:DELETE=9,cinder:INSERT=17 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:04:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-52797ce2-235d-4dcb-ace4-510dc558f462 tempest-TestServerVolumeAttachScenarioOldVersion-771306609 None] Lock "cinder-5ae62e97-f8c6-497e-aed5-49f3f314c9f9-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:04:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:26 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:04:26 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:26 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.653s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:04:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Acquiring lock "cinder-8f70b4d6-65af-4730-9ebb-64573eb9367b-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Lock "cinder-8f70b4d6-65af-4730-9ebb-64573eb9367b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Acquiring lock "cinder-quobyte-8f70b4d6-65af-4730-9ebb-64573eb9367b" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:04:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Lock "cinder-quobyte-8f70b4d6-65af-4730-9ebb-64573eb9367b" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:04:28 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76c0dfc-3c28-4da6-82b0-3975dac7bdbb]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:04:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8f70b4d6-65af-4730-9ebb-64573eb9367b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:28 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8f70b4d6-65af-4730-9ebb-64573eb9367b Jul 03 14:04:28 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:28 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8f70b4d6-65af-4730-9ebb-64573eb9367b" returned: 0 in 0.756s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8f70b4d6-65af-4730-9ebb-64573eb9367b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:28 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8f70b4d6-65af-4730-9ebb-64573eb9367b Jul 03 14:04:28 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:29 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8f70b4d6-65af-4730-9ebb-64573eb9367b" returned: 0 in 0.652s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Lock "cinder-quobyte-8f70b4d6-65af-4730-9ebb-64573eb9367b" released by "delete_volume" :: held 1.451s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:29 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Created reservations ['72b9f082-7dfc-4e7f-bebf-195d166ff3b5', 'ae95741c-87ee-4a53-a300-405219c91849', '606c0395-2016-4b6a-964f-4aeb7b35ee2f', '9c8f461f-c5f6-4142-ab48-d74317d21193'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:04:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:04:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:04:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:04:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:04:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:04:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:04:29 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:04:29 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:04:30 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Jul 03 14:04:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.670s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:04:30 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:04:30 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Deleted volume successfully. Jul 03 14:04:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d99271aa-1fda-49ed-89fa-55d1e6804aba tempest-VolumesNegativeTest-246303862 None] Lock "cinder-8f70b4d6-65af-4730-9ebb-64573eb9367b-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:04:39 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=7,cinder:SELECT=6,cinder:INSERT=2 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:04:40 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Flow 'volume_create_manager' (f427229c-4afd-4375-80fa-b217af7fd53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf25707-3de2-4426-a660-11a2f4bbc043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf25707-3de2-4426-a660-11a2f4bbc043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1594396026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8efc1e-97e6-4b1a-9647-7357f65802b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d9eb161e29404697301f1ad057ff65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:01Z,use_quota=True,user_id='f78821d62f824306a6b2c07ed260cbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f68ec6-4e9b-45a3-8693-f9f271e537e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f68ec6-4e9b-45a3-8693-f9f271e537e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eeff417-7aaa-4217-a4b4-724602aac3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eeff417-7aaa-4217-a4b4-724602aac3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8efc1e-97e6-4b1a-9647-7357f65802b0', 'volume_name': 'volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69bff2a4-f78a-4c17-b354-53999a8eda03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69bff2a4-f78a-4c17-b354-53999a8eda03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79faa37e-eda2-4b42-b2f2-af3e39a56029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:00 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Volume 9e8efc1e-97e6-4b1a-9647-7357f65802b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0', 'volume_size': 1} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1594396026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8efc1e-97e6-4b1a-9647-7357f65802b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d9eb161e29404697301f1ad057ff65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:01Z,use_quota=True,user_id='f78821d62f824306a6b2c07ed260cbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Creating volume 9e8efc1e-97e6-4b1a-9647-7357f65802b0 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:05:00 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:05:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:01 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0 1073741824 Jul 03 14:05:01 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:01 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:05:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Flow 'volume_create_manager' (59f8794e-a9f3-49cb-9857-c6d52af8a874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e97f70d-9603-4668-829c-ac6b30fca788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e97f70d-9603-4668-829c-ac6b30fca788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1865859900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef905bd3-c10e-40ef-ae48-24c8517af99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d9eb161e29404697301f1ad057ff65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:01Z,use_quota=True,user_id='f78821d62f824306a6b2c07ed260cbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96cbcb34-c3b3-4c3e-9813-0c4ad7ab426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96cbcb34-c3b3-4c3e-9813-0c4ad7ab426c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4ee786-8fb3-42f5-9927-d1020e1ec4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4ee786-8fb3-42f5-9927-d1020e1ec4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef905bd3-c10e-40ef-ae48-24c8517af99e', 'volume_name': 'volume-ef905bd3-c10e-40ef-ae48-24c8517af99e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911afb4e-e6ca-48f9-9693-fae51ccadf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911afb4e-e6ca-48f9-9693-fae51ccadf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6711cb67-bf56-494a-9439-771db687406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:01 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Volume ef905bd3-c10e-40ef-ae48-24c8517af99e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef905bd3-c10e-40ef-ae48-24c8517af99e', 'volume_size': 1} Jul 03 14:05:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:02 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0 1073741824" returned: 0 in 1.151s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:02 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0 Jul 03 14:05:02 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:02 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0" returned: 0 in 0.744s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.562s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1865859900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef905bd3-c10e-40ef-ae48-24c8517af99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d9eb161e29404697301f1ad057ff65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:01Z,use_quota=True,user_id='f78821d62f824306a6b2c07ed260cbae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Creating volume ef905bd3-c10e-40ef-ae48-24c8517af99e {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:05:02 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:02 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e 1073741824 Jul 03 14:05:02 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79faa37e-eda2-4b42-b2f2-af3e39a56029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4271d8c-7c60-4c0a-bead-1e488fb84789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:02 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Volume volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0 (9e8efc1e-97e6-4b1a-9647-7357f65802b0): created successfully Jul 03 14:05:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4271d8c-7c60-4c0a-bead-1e488fb84789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Flow 'volume_create_manager' (f427229c-4afd-4375-80fa-b217af7fd53f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:03 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-978a2b4e-8167-44c5-aa97-5342dda4ca3a tempest-TestServerVolumeAttachmentScenario-1294001493 None] Created volume successfully. Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Flow 'volume_create_manager' (ae44ef59-9e26-4565-b5a0-95749f062307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f54adc4-9a93-400c-bbe5-c18e80b0da7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f54adc4-9a93-400c-bbe5-c18e80b0da7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-30360851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4050d8aa-0403-475e-b844-a93183e2c34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77806f16df8a415c9af9b7a3f9679000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:04Z,use_quota=True,user_id='b4a9254959b847f0a239662c5d57790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4cdf4f3-6add-438a-b421-1bd70f63c0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4cdf4f3-6add-438a-b421-1bd70f63c0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66e0f9a-074e-4f09-9d04-15449f1e4c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66e0f9a-074e-4f09-9d04-15449f1e4c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4050d8aa-0403-475e-b844-a93183e2c34c', 'volume_name': 'volume-4050d8aa-0403-475e-b844-a93183e2c34c', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c171b2c-4a51-4fb0-8639-7f3b9a4f2b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c171b2c-4a51-4fb0-8639-7f3b9a4f2b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8291a89d-056c-4c10-b05d-49062b28d84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:03 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Volume 4050d8aa-0403-475e-b844-a93183e2c34c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4050d8aa-0403-475e-b844-a93183e2c34c', 'volume_size': 1} Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:03 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e 1073741824" returned: 0 in 1.030s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:04 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:04 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:04 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e" returned: 0 in 0.756s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.838s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-30360851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4050d8aa-0403-475e-b844-a93183e2c34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77806f16df8a415c9af9b7a3f9679000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:05:04Z,use_quota=True,user_id='b4a9254959b847f0a239662c5d57790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Creating volume 4050d8aa-0403-475e-b844-a93183e2c34c {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:05:04 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:04 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c 1073741824 Jul 03 14:05:04 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6711cb67-bf56-494a-9439-771db687406d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef905bd3-c10e-40ef-ae48-24c8517af99e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f8e1d9-7831-4328-8dc9-30d458643c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:04 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Volume volume-ef905bd3-c10e-40ef-ae48-24c8517af99e (ef905bd3-c10e-40ef-ae48-24c8517af99e): created successfully Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f8e1d9-7831-4328-8dc9-30d458643c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Flow 'volume_create_manager' (59f8794e-a9f3-49cb-9857-c6d52af8a874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-02c9a483-23ef-4377-a36c-c28f8713b6ec tempest-TestServerVolumeAttachmentScenario-1294001493 None] Created volume successfully. Jul 03 14:05:05 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c 1073741824" returned: 0 in 0.962s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:05 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c Jul 03 14:05:05 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:06 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c" returned: 0 in 0.700s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:05:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8291a89d-056c-4c10-b05d-49062b28d84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4050d8aa-0403-475e-b844-a93183e2c34c', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74375f7-c726-40dd-854d-ef54f132dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:05:06 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Volume volume-4050d8aa-0403-475e-b844-a93183e2c34c (4050d8aa-0403-475e-b844-a93183e2c34c): created successfully Jul 03 14:05:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74375f7-c726-40dd-854d-ef54f132dd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:05:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Flow 'volume_create_manager' (ae44ef59-9e26-4565-b5a0-95749f062307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:05:06 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d3eb4fd5-f010-4fc4-b13f-9b967c96a7d5 tempest-TestStampPattern-1026759899 None] Created volume successfully. Jul 03 14:05:16 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=12,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:05:16 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=2 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:05:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:05:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:05:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:05:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:26 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:05:26 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:26 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.668s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:05:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:05:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:05:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-c1c86da7-2d9f-45b8-b1ad-6562f6bc4ee5 req-63d2c088-db0e-4433-81bc-438969ca6460 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-c1c86da7-2d9f-45b8-b1ad-6562f6bc4ee5 req-63d2c088-db0e-4433-81bc-438969ca6460 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:45 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5338a7e2-84d0-4929-9453-35d484a65e6e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-c1c86da7-2d9f-45b8-b1ad-6562f6bc4ee5 req-63d2c088-db0e-4433-81bc-438969ca6460 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:45 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0 Jul 03 14:05:45 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:46 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-c1c86da7-2d9f-45b8-b1ad-6562f6bc4ee5 req-63d2c088-db0e-4433-81bc-438969ca6460 tempest-TestServerVolumeAttachmentScenario-1294001493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0" returned: 0 in 0.716s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-c1c86da7-2d9f-45b8-b1ad-6562f6bc4ee5 req-63d2c088-db0e-4433-81bc-438969ca6460 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.732s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-c1c86da7-2d9f-45b8-b1ad-6562f6bc4ee5 req-63d2c088-db0e-4433-81bc-438969ca6460 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e87deda-43f4-4bf7-8af8-06391e55e71c', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:05:46 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-c1c86da7-2d9f-45b8-b1ad-6562f6bc4ee5 req-63d2c088-db0e-4433-81bc-438969ca6460 tempest-TestServerVolumeAttachmentScenario-1294001493 None] attachment_update completed successfully. Jul 03 14:05:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-53c240b0-0d06-4807-a323-02be970076a5 req-4f11fc6b-1e90-460a-9f12-e230619b3846 tempest-TestStampPattern-1026759899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-53c240b0-0d06-4807-a323-02be970076a5 req-4f11fc6b-1e90-460a-9f12-e230619b3846 tempest-TestStampPattern-1026759899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb04fc7-eb09-418d-af24-9b31df6aea28]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-53c240b0-0d06-4807-a323-02be970076a5 req-4f11fc6b-1e90-460a-9f12-e230619b3846 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:47 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c Jul 03 14:05:47 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:48 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-53c240b0-0d06-4807-a323-02be970076a5 req-4f11fc6b-1e90-460a-9f12-e230619b3846 tempest-TestStampPattern-1026759899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c" returned: 0 in 0.769s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-53c240b0-0d06-4807-a323-02be970076a5 req-4f11fc6b-1e90-460a-9f12-e230619b3846 tempest-TestStampPattern-1026759899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.788s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-53c240b0-0d06-4807-a323-02be970076a5 req-4f11fc6b-1e90-460a-9f12-e230619b3846 tempest-TestStampPattern-1026759899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-4050d8aa-0403-475e-b844-a93183e2c34c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff519820-e7dd-41fc-b6ce-aeab8226ec0c', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:05:48 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-53c240b0-0d06-4807-a323-02be970076a5 req-4f11fc6b-1e90-460a-9f12-e230619b3846 tempest-TestStampPattern-1026759899 None] attachment_update completed successfully. Jul 03 14:05:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-83442880-5c62-47ca-b06e-7af1b31ff145 req-2d3e705c-92fc-4469-a7cd-925d25bd9f89 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-83442880-5c62-47ca-b06e-7af1b31ff145 req-2d3e705c-92fc-4469-a7cd-925d25bd9f89 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3a57ae-0c75-43c5-b0ad-4cf5f5e9fb05]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-83442880-5c62-47ca-b06e-7af1b31ff145 req-2d3e705c-92fc-4469-a7cd-925d25bd9f89 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:55 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e Jul 03 14:05:55 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:56 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-83442880-5c62-47ca-b06e-7af1b31ff145 req-2d3e705c-92fc-4469-a7cd-925d25bd9f89 tempest-TestServerVolumeAttachmentScenario-1294001493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e" returned: 0 in 0.767s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-83442880-5c62-47ca-b06e-7af1b31ff145 req-2d3e705c-92fc-4469-a7cd-925d25bd9f89 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.788s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:05:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-83442880-5c62-47ca-b06e-7af1b31ff145 req-2d3e705c-92fc-4469-a7cd-925d25bd9f89 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-ef905bd3-c10e-40ef-ae48-24c8517af99e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6321148f-3073-4ca5-af70-d51147c63dd7', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:05:56 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-83442880-5c62-47ca-b06e-7af1b31ff145 req-2d3e705c-92fc-4469-a7cd-925d25bd9f89 tempest-TestServerVolumeAttachmentScenario-1294001493 None] attachment_update completed successfully. Jul 03 14:05:56 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-3b60987f-549e-4f64-9bce-d7249c6050a7 req-9232373b-b7ff-4384-99e8-6ce67f12842e tempest-TestStampPattern-1026759899 None] Terminate volume connection completed successfully. Jul 03 14:05:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-3b60987f-549e-4f64-9bce-d7249c6050a7 req-9232373b-b7ff-4384-99e8-6ce67f12842e tempest-TestStampPattern-1026759899 None] Deleting attachment ff519820-e7dd-41fc-b6ce-aeab8226ec0c. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:05:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:05:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:05:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] Creating offline snapshot c44c9d93-34a9-4b53-bfb0-979274def6f4 of volume 4050d8aa-0403-475e-b844-a93183e2c34c {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:05:58 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c61100a-5305-4d90-a497-3a9267a7e6f5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:05:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:59 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c Jul 03 14:05:59 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:05:59 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Jul 03 14:05:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c" returned: 0 in 0.753s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:05:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:05:59 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 1G Jul 03 14:05:59 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:00 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 1G" returned: 0 in 0.804s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4050d8aa-0403-475e-b844-a93183e2c34c -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:00 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4050d8aa-0403-475e-b844-a93183e2c34c -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 Jul 03 14:06:00 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:01 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4050d8aa-0403-475e-b844-a93183e2c34c -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4" returned: 0 in 0.733s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:01 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 is being set with open permissions: ugo+rw Jul 03 14:06:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:01 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 Jul 03 14:06:01 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:01 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4" returned: 0 in 0.693s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:02 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.info Jul 03 14:06:02 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:02 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-00072d32-786c-431b-9798-773def4efe4a req-31fc02bd-e3c0-4abe-b48d-dc0d3a9ce652 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Terminate volume connection completed successfully. Jul 03 14:06:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-00072d32-786c-431b-9798-773def4efe4a req-31fc02bd-e3c0-4abe-b48d-dc0d3a9ce652 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Deleting attachment 6321148f-3073-4ca5-af70-d51147c63dd7. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:06:02 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.info" returned: 0 in 0.698s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:02 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.info is being set with open permissions: ugo+rw Jul 03 14:06:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:02 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.info Jul 03 14:06:02 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:03 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.info" returned: 0 in 0.672s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.434s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:03 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-31218b94-9480-4da7-8127-dba4c681996a tempest-TestStampPattern-1026759899 None] Create snapshot completed successfully Jul 03 14:06:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-f44c77fe-0acc-483b-86c6-86addc037822 req-3959ea18-3b4a-4522-ae00-ccdae6664afd tempest-TestServerVolumeAttachmentScenario-1294001493 None] Terminate volume connection completed successfully. Jul 03 14:06:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-f44c77fe-0acc-483b-86c6-86addc037822 req-3959ea18-3b4a-4522-ae00-ccdae6664afd tempest-TestServerVolumeAttachmentScenario-1294001493 None] Deleting attachment 7e87deda-43f4-4bf7-8af8-06391e55e71c. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Flow 'volume_create_manager' (ba44b48b-2a10-4b18-97d1-6b785b3dd972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca25d868-9065-4578-bfcd-092d791f8a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca25d868-9065-4578-bfcd-092d791f8a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-676147113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77806f16df8a415c9af9b7a3f9679000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c44c9d93-34a9-4b53-bfb0-979274def6f4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:14Z,use_quota=True,user_id='b4a9254959b847f0a239662c5d57790a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bf4b65-f1b6-4964-a170-1de4e4b4f778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bf4b65-f1b6-4964-a170-1de4e4b4f778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d34c2d7-e9e3-4c23-838f-ddc815c8b561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d34c2d7-e9e3-4c23-838f-ddc815c8b561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1', 'volume_name': 'volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1', 'volume_size': 1, 'snapshot_id': 'c44c9d93-34a9-4b53-bfb0-979274def6f4'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1114e8f4-19c6-4740-9fb4-7f171147c188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1114e8f4-19c6-4740-9fb4-7f171147c188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c7744c-da4f-4ff4-8986-5c7d21206c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:14 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Volume fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1', 'volume_size': 1, 'snapshot_id': 'c44c9d93-34a9-4b53-bfb0-979274def6f4'} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Acquiring lock "cinder-quobyte-c44c9d93-34a9-4b53-bfb0-979274def6f4-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" by "_create_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Lock "cinder-quobyte-c44c9d93-34a9-4b53-bfb0-979274def6f4-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Creating volume fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 from snapshot c44c9d93-34a9-4b53-bfb0-979274def6f4 {{(pid=86729) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Acquiring lock "cinder-quobyte-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" by "_copy_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Lock "cinder-quobyte-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] snapshot: c44c9d93-34a9-4b53-bfb0-979274def6f4, volume: fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1, {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3062651-e3dc-402c-9663-d14580b0f7c5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:14 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 Jul 03 14:06:14 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:15 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4" returned: 0 in 0.831s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4050d8aa-0403-475e-b844-a93183e2c34c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:06:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:06:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Creating direct copy from snapshot {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:06:15 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[459783c2-da47-4d32-9f9d-55f531e11df1]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:15 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c Jul 03 14:06:15 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:16 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c" returned: 0 in 0.794s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:16 devstack cinder-volume[86729]: DEBUG cinder.utils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Path /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 not found in is_blk_device check {{(pid=86729) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:06:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:16 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 Jul 03 14:06:16 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Acquiring lock "cinder-ef905bd3-c10e-40ef-ae48-24c8517af99e-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "cinder-ef905bd3-c10e-40ef-ae48-24c8517af99e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Acquiring lock "cinder-quobyte-ef905bd3-c10e-40ef-ae48-24c8517af99e" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "cinder-quobyte-ef905bd3-c10e-40ef-ae48-24c8517af99e" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:16 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6907305-e014-48e6-aca8-103fa2df2b2b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:16 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e Jul 03 14:06:16 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:18 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e" returned: 0 in 1.645s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:18 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e Jul 03 14:06:18 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:19 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ef905bd3-c10e-40ef-ae48-24c8517af99e" returned: 0 in 1.415s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "cinder-quobyte-ef905bd3-c10e-40ef-ae48-24c8517af99e" released by "delete_volume" :: held 3.128s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:19 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Created reservations ['f494aca7-6fca-43f0-92ee-0ac960843b90', '8e7ef1f9-355d-4dc2-8e07-1d0564e2c1ae', 'c8c90be3-8680-4b12-b68f-d9c2c03eeb7d', '95fe57f1-f876-4044-8a36-2ba10b614957'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:20 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:06:20 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Acquiring lock "cinder-9e8efc1e-97e6-4b1a-9647-7357f65802b0-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "cinder-9e8efc1e-97e6-4b1a-9647-7357f65802b0-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Acquiring lock "cinder-quobyte-9e8efc1e-97e6-4b1a-9647-7357f65802b0" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "cinder-quobyte-9e8efc1e-97e6-4b1a-9647-7357f65802b0" acquired by "delete_volume" :: waited 0.052s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:20 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b695893-4c5a-44a1-aaa9-1fcac67a62ba]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:20 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0 Jul 03 14:06:20 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:21 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0" returned: 0 in 1.376s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:21 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.981s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:21 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:21 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0 Jul 03 14:06:21 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:21 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:21 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Deleted volume successfully. Jul 03 14:06:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" returned: 0 in 5.866s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:21 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6749e09-2f8e-46a3-821a-da3ef8b6a59f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:21 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-27fbf08d-cd2f-481a-aaab-71241180c23d tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "cinder-ef905bd3-c10e-40ef-ae48-24c8517af99e-delete_volume" released by "delete_volume" :: held 5.489s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:22 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c Jul 03 14:06:22 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:22 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9e8efc1e-97e6-4b1a-9647-7357f65802b0" returned: 0 in 0.937s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "cinder-quobyte-9e8efc1e-97e6-4b1a-9647-7357f65802b0" released by "delete_volume" :: held 2.410s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:23 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Created reservations ['ed3dd34f-e1d1-4999-b130-4c441c04bd67', '2ff6b416-e7b9-4338-818e-c44f7124d20b', '2c2d800a-1de2-4326-81c0-41c26776f98f', '1987a276-66aa-443e-9a2f-3ee8d906286d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:23 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:06:23 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:23 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c" returned: 0 in 1.385s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:23 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:06:23 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Converted 1024.00 MB image at 174.54 MB/s Jul 03 14:06:23 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 is being set with open permissions: ugo+rw Jul 03 14:06:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:23 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 Jul 03 14:06:23 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:23 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.856s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:24 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:24 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Deleted volume successfully. Jul 03 14:06:24 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d387c172-8054-43c8-987a-5957558811f8 tempest-TestServerVolumeAttachmentScenario-1294001493 None] Lock "cinder-9e8efc1e-97e6-4b1a-9647-7357f65802b0-delete_volume" released by "delete_volume" :: held 3.786s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:24 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" returned: 0 in 0.910s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:24 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Lock "cinder-quobyte-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" released by "_copy_volume_from_snapshot" :: held 9.898s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:24 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Lock "cinder-quobyte-c44c9d93-34a9-4b53-bfb0-979274def6f4-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" released by "_create_volume_from_snapshot" :: held 9.934s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.951s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c7744c-da4f-4ff4-8986-5c7d21206c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1', 'volume_size': 1, 'snapshot_id': 'c44c9d93-34a9-4b53-bfb0-979274def6f4'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339444fd-aaba-4746-9e71-ebf2cb646337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:24 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Volume volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 (fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1): created successfully Jul 03 14:06:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339444fd-aaba-4746-9e71-ebf2cb646337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Flow 'volume_create_manager' (ba44b48b-2a10-4b18-97d1-6b785b3dd972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:24 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-57f9ff50-87ea-4df8-8f0b-38b54f662053 tempest-TestStampPattern-1026759899 None] Created volume successfully. Jul 03 14:06:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:06:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:26 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:06:26 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:26 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.686s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:34 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=32,cinder:UPDATE=30,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:06:34 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=39,cinder:UPDATE=18,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:06:39 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:06:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Flow 'volume_create_manager' (e2bc3dc6-1198-429b-a065-1a4e864e4a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b94dfb-8357-49d2-92b8-bb3a4746d406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b94dfb-8357-49d2-92b8-bb3a4746d406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd67a2d-4915-46ab-897a-db9e328c9a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdf73ef83494794922963d726bfc45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:40Z,use_quota=True,user_id='dcec44b8da184b93adc7bbd67520548f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(538647f8-a750-4707-a000-56e0a74b500f),volume_type_id=538647f8-a750-4707-a000-56e0a74b500f)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99755c55-b311-466f-b116-13c0826e8e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99755c55-b311-466f-b116-13c0826e8e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d9bfe7-ab72-4edf-bf0b-ee8d07013ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:39 devstack cinder-volume[86729]: DEBUG cinder.image.glance [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Creating Keystone auth plugin from conf {{(pid=86729) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:06:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d9bfe7-ab72-4edf-bf0b-ee8d07013ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'acd67a2d-4915-46ab-897a-db9e328c9a12', 'volume_name': 'volume-acd67a2d-4915-46ab-897a-db9e328c9a12', 'volume_size': 1, 'image_id': '52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a90851f0bfb41bf120febe783b92d53b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfdf73ef83494794922963d726bfc45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'de624f9180669b3226a9e07c57e1bffb1a2fd80d576351e744f8e7646c42d015a7c977b045069ac005ebf6b64048399f59055fc3ba105f0fe002e10a725b479c', 'id': '52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'created_at': datetime.datetime(2026, 7, 3, 12, 6, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f310104c-cff5-4ff6-b902-5bbcf30ba349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f310104c-cff5-4ff6-b902-5bbcf30ba349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b152412f-5522-490d-af5d-8f00904adb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:40 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Volume acd67a2d-4915-46ab-897a-db9e328c9a12: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-acd67a2d-4915-46ab-897a-db9e328c9a12', 'volume_size': 1, 'image_id': '52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a90851f0bfb41bf120febe783b92d53b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfdf73ef83494794922963d726bfc45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'de624f9180669b3226a9e07c57e1bffb1a2fd80d576351e744f8e7646c42d015a7c977b045069ac005ebf6b64048399f59055fc3ba105f0fe002e10a725b479c', 'id': '52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'created_at': datetime.datetime(2026, 7, 3, 12, 6, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 14:06:40 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Trying to clone acd67a2d-4915-46ab-897a-db9e328c9a12 from image 52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'metadata': {}}]). {{(pid=86729) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:06:40 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:06:40 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Image download 0.00 MB at 0.00 MB/s Jul 03 14:06:40 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a01e382-1324-4b1e-b301-7950d8d264e6]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:40 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD Jul 03 14:06:40 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:40 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD" returned: 0 in 0.684s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:41 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD Jul 03 14:06:41 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:41 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD" returned: 1 in 0.732s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:06:41 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Temporary image 52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4 is fetched for user dcec44b8da184b93adc7bbd67520548f. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:06:41 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05db569-2a91-48c1-96e6-0f182815d172]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:41 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD Jul 03 14:06:41 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:42 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD" returned: 0 in 0.699s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:42 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD Jul 03 14:06:42 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:43 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD" returned: 1 in 0.722s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd67a2d-4915-46ab-897a-db9e328c9a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdf73ef83494794922963d726bfc45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:40Z,use_quota=True,user_id='dcec44b8da184b93adc7bbd67520548f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(538647f8-a750-4707-a000-56e0a74b500f),volume_type_id=538647f8-a750-4707-a000-56e0a74b500f)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Creating volume acd67a2d-4915-46ab-897a-db9e328c9a12 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:06:43 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:06:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:43 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 1073741824 Jul 03 14:06:43 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:44 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 1073741824" returned: 0 in 0.849s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:44 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 Jul 03 14:06:44 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:44 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12" returned: 0 in 0.653s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:06:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:44 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Attempting download of 52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'metadata': {}}])) to volume acd67a2d-4915-46ab-897a-db9e328c9a12. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:06:44 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2059b4-0043-4116-a572-670869e71add]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_tfi70aj_ {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:44 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_tfi70aj_ Jul 03 14:06:44 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:45 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_tfi70aj_" returned: 0 in 0.734s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_tfi70aj_ {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:45 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_tfi70aj_ Jul 03 14:06:45 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:46 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_tfi70aj_" returned: 1 in 0.695s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_tfi70aj_' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:06:46 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cb8908-9bf5-4cef-ae00-4942f4df9ca4]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:46 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD Jul 03 14:06:46 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:46 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD" returned: 0 in 0.693s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:47 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD Jul 03 14:06:47 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:47 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD" returned: 1 in 0.717s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:06:47 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] 52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4 was raw, converting to raw {{(pid=86729) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:06:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:47 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 Jul 03 14:06:47 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:48 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12" returned: 0 in 0.700s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:48 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4_6xu8tv8jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:06:48 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 14:06:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:48 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 1G Jul 03 14:06:48 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:49 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 1G" returned: 0 in 0.695s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:49 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4be534e-cbc6-4f3a-93bb-431479c9ad86]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:49 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 Jul 03 14:06:49 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:49 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12" returned: 0 in 0.722s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:49 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 Jul 03 14:06:49 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:50 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12" returned: 1 in 0.751s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:06:50 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Downloaded image 52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'metadata': {}}])) to volume acd67a2d-4915-46ab-897a-db9e328c9a12 successfully. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:06:50 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Temporary image 52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4 for user dcec44b8da184b93adc7bbd67520548f is deleted. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:06:50 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Marking volume acd67a2d-4915-46ab-897a-db9e328c9a12 as bootable. {{(pid=86729) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:06:50 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Copying metadata from image 52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4 to acd67a2d-4915-46ab-897a-db9e328c9a12. {{(pid=86729) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:06:50 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Creating volume glance metadata for volume acd67a2d-4915-46ab-897a-db9e328c9a12 backed by image 52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a90851f0bfb41bf120febe783b92d53b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86729) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:06:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b152412f-5522-490d-af5d-8f00904adb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd67a2d-4915-46ab-897a-db9e328c9a12', 'volume_size': 1, 'image_id': '52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a90851f0bfb41bf120febe783b92d53b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfdf73ef83494794922963d726bfc45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'de624f9180669b3226a9e07c57e1bffb1a2fd80d576351e744f8e7646c42d015a7c977b045069ac005ebf6b64048399f59055fc3ba105f0fe002e10a725b479c', 'id': '52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4', 'created_at': datetime.datetime(2026, 7, 3, 12, 6, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 6, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52d8a4b8-72a9-4ba8-b45b-2d3d4b97a9f4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1319bf83-f5c7-412e-83b6-483e6378c930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:50 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Volume volume-acd67a2d-4915-46ab-897a-db9e328c9a12 (acd67a2d-4915-46ab-897a-db9e328c9a12): created successfully Jul 03 14:06:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1319bf83-f5c7-412e-83b6-483e6378c930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Flow 'volume_create_manager' (e2bc3dc6-1198-429b-a065-1a4e864e4a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-adc14f06-3ca8-4da8-b941-3b7b2d19e844 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Created volume successfully. Jul 03 14:06:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Acquiring lock "cinder-acd67a2d-4915-46ab-897a-db9e328c9a12-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Lock "cinder-acd67a2d-4915-46ab-897a-db9e328c9a12-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Acquiring lock "cinder-quobyte-acd67a2d-4915-46ab-897a-db9e328c9a12" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:06:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Lock "cinder-quobyte-acd67a2d-4915-46ab-897a-db9e328c9a12" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:06:51 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8653a8-69a3-4d60-b6c1-2aaaffdf0ecb]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:06:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:51 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 Jul 03 14:06:51 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:52 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12" returned: 0 in 0.763s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:52 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 Jul 03 14:06:52 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:52 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12" returned: 1 in 0.746s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:06:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:53 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12 Jul 03 14:06:53 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:53 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-acd67a2d-4915-46ab-897a-db9e328c9a12" returned: 0 in 0.614s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Lock "cinder-quobyte-acd67a2d-4915-46ab-897a-db9e328c9a12" released by "delete_volume" :: held 2.181s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:53 devstack cinder-volume[86729]: WARNING cinder.quota [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:06:53 devstack cinder-volume[86729]: WARNING cinder.quota [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 14:06:53 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Created reservations ['a89ce2ff-105b-43ee-bbab-86d5f43cdb13', '39a672cf-18c1-4796-8e35-4cb1379c6230', '51086f00-dedb-422b-8b61-1e961a4a3f58', '0ca0c3cc-5c7b-4efc-aff9-675280a14b71'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:06:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:53 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:06:53 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:06:54 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 03 14:06:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.645s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:06:54 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:06:54 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Deleted volume successfully. Jul 03 14:06:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d0b5ccd9-3f4f-41fa-b55f-e86222fbc0d6 tempest-VolumeAndVolumeTypeFromImageTest-416128807 None] Lock "cinder-acd67a2d-4915-46ab-897a-db9e328c9a12-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Flow 'volume_create_manager' (49d30b44-b260-4540-8a73-33b601feb1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b46ff0-74bf-4705-9cd7-193e037deaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b46ff0-74bf-4705-9cd7-193e037deaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-245446614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e587bc79-e2f2-434b-b0c3-dc3139f44849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d0136503f1450487a462242cb0f434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:59Z,use_quota=True,user_id='af5ea4dc91724b7e8f8aec2e0bcac3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb03e02e-f0b8-4bfd-95c6-75843cf1ad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb03e02e-f0b8-4bfd-95c6-75843cf1ad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb642223-577e-4c77-8b5d-4c8bf93eb5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb642223-577e-4c77-8b5d-4c8bf93eb5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e587bc79-e2f2-434b-b0c3-dc3139f44849', 'volume_name': 'volume-e587bc79-e2f2-434b-b0c3-dc3139f44849', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53713321-f3e6-465c-a1d3-a878092c4185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53713321-f3e6-465c-a1d3-a878092c4185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9175edc9-37ba-40a7-86f2-8111abe376a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:06:59 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume e587bc79-e2f2-434b-b0c3-dc3139f44849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e587bc79-e2f2-434b-b0c3-dc3139f44849', 'volume_size': 1} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-245446614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e587bc79-e2f2-434b-b0c3-dc3139f44849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d0136503f1450487a462242cb0f434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:06:59Z,use_quota=True,user_id='af5ea4dc91724b7e8f8aec2e0bcac3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Creating volume e587bc79-e2f2-434b-b0c3-dc3139f44849 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:06:59 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:06:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:06:59 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 1073741824 Jul 03 14:06:59 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:00 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 1073741824" returned: 0 in 0.834s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:00 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 Jul 03 14:07:00 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:00 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849" returned: 0 in 0.643s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9175edc9-37ba-40a7-86f2-8111abe376a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e587bc79-e2f2-434b-b0c3-dc3139f44849', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb58cce-04a9-4d40-a611-d4e333d17b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:00 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 (e587bc79-e2f2-434b-b0c3-dc3139f44849): created successfully Jul 03 14:07:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb58cce-04a9-4d40-a611-d4e333d17b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Flow 'volume_create_manager' (49d30b44-b260-4540-8a73-33b601feb1be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:00 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3b5c9326-c81f-48ab-83d0-7386c2dc0f45 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created volume successfully. Jul 03 14:07:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] Creating offline snapshot 31930f2c-c8f9-493c-b091-fd91f78de24b of volume e587bc79-e2f2-434b-b0c3-dc3139f44849 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:07:01 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddae91e-077a-44ca-babf-5492312b65e8]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:01 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 Jul 03 14:07:01 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:02 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849" returned: 0 in 0.746s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:02 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b 1G Jul 03 14:07:02 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:03 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b 1G" returned: 0 in 0.804s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:03 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b Jul 03 14:07:03 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:03 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b" returned: 0 in 0.702s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:03 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b is being set with open permissions: ugo+rw Jul 03 14:07:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:03 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b Jul 03 14:07:03 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:04 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b" returned: 0 in 0.647s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:04 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.info Jul 03 14:07:04 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:05 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.info" returned: 0 in 0.657s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:05 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.info is being set with open permissions: ugo+rw Jul 03 14:07:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:05 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.info Jul 03 14:07:05 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:05 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.info" returned: 0 in 0.641s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.286s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9ecc6e60-f394-4b82-8c63-c94756294b3b tempest-CreateVolumesFromSnapshotTest-1256902343 None] Create snapshot completed successfully Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Flow 'volume_create_manager' (727bd92e-2818-442f-8b44-6ca9d796f3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bc3c27-1900-4c27-aa2c-5e89d5607609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bc3c27-1900-4c27-aa2c-5e89d5607609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-542816481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4a8027-dcff-49a4-a841-36b37231c22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d0136503f1450487a462242cb0f434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:07Z,use_quota=True,user_id='af5ea4dc91724b7e8f8aec2e0bcac3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6739a6ad-97a3-4449-9629-0995902ab05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6739a6ad-97a3-4449-9629-0995902ab05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f5990c-daa3-4e88-9b69-abae8f42960a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f5990c-daa3-4e88-9b69-abae8f42960a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b4a8027-dcff-49a4-a841-36b37231c22b', 'volume_name': 'volume-9b4a8027-dcff-49a4-a841-36b37231c22b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0bc3bb-f065-4f66-95bd-abde9d76e5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0bc3bb-f065-4f66-95bd-abde9d76e5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74275ea-6048-403d-ab22-ba335936fa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume 9b4a8027-dcff-49a4-a841-36b37231c22b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b4a8027-dcff-49a4-a841-36b37231c22b', 'volume_size': 1} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-542816481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4a8027-dcff-49a4-a841-36b37231c22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d0136503f1450487a462242cb0f434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:07Z,use_quota=True,user_id='af5ea4dc91724b7e8f8aec2e0bcac3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Creating volume 9b4a8027-dcff-49a4-a841-36b37231c22b {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:07 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9b4a8027-dcff-49a4-a841-36b37231c22b 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:07 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9b4a8027-dcff-49a4-a841-36b37231c22b 1073741824 Jul 03 14:07:07 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Flow 'volume_create_manager' (a2e7d0bf-c833-4de9-890d-7fe2c562eaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a159496-e342-465d-8b47-2a5dc2a51d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a159496-e342-465d-8b47-2a5dc2a51d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-605899573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50eff520-da36-4cf4-ae78-df64d2dd943b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d0136503f1450487a462242cb0f434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:07Z,use_quota=True,user_id='af5ea4dc91724b7e8f8aec2e0bcac3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a73fe4-a56b-46c6-85b9-89696e80ecd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a73fe4-a56b-46c6-85b9-89696e80ecd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ac617c-28ac-43b7-adfa-9f0eaccc8654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ac617c-28ac-43b7-adfa-9f0eaccc8654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50eff520-da36-4cf4-ae78-df64d2dd943b', 'volume_name': 'volume-50eff520-da36-4cf4-ae78-df64d2dd943b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d8fe57-8949-425a-93ab-4c0c874647fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d8fe57-8949-425a-93ab-4c0c874647fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29eca102-01f5-481c-8e89-327c53899f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume 50eff520-da36-4cf4-ae78-df64d2dd943b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50eff520-da36-4cf4-ae78-df64d2dd943b', 'volume_size': 1} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Flow 'volume_create_manager' (1918e518-e7ce-4bc4-872a-0ff4f48cd1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622fd408-636a-462f-a9ac-f56d68267f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622fd408-636a-462f-a9ac-f56d68267f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1891215414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6903791-e393-4899-a157-4faffb0ad87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d0136503f1450487a462242cb0f434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:08Z,use_quota=True,user_id='af5ea4dc91724b7e8f8aec2e0bcac3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0206b59-d40c-4bc5-953f-b144ee5a905c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0206b59-d40c-4bc5-953f-b144ee5a905c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9161c0e5-b76d-4a62-8a7a-2e8ea12742d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9161c0e5-b76d-4a62-8a7a-2e8ea12742d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6903791-e393-4899-a157-4faffb0ad87f', 'volume_name': 'volume-b6903791-e393-4899-a157-4faffb0ad87f', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec298fa3-20e3-4ab6-a717-93c790c0a214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec298fa3-20e3-4ab6-a717-93c790c0a214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea39701-f200-413f-8a2f-6674595722c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:07 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume b6903791-e393-4899-a157-4faffb0ad87f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6903791-e393-4899-a157-4faffb0ad87f', 'volume_size': 1} Jul 03 14:07:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:08 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9b4a8027-dcff-49a4-a841-36b37231c22b 1073741824" returned: 0 in 0.960s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Flow 'volume_create_manager' (2c9518c4-037c-4135-8b1a-3b509bc40b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5065a0-166b-483b-b8d8-3066d0c655d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5065a0-166b-483b-b8d8-3066d0c655d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-833150175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d0136503f1450487a462242cb0f434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:08Z,use_quota=True,user_id='af5ea4dc91724b7e8f8aec2e0bcac3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1707e490-10e4-4997-aaf9-3501c9357535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1707e490-10e4-4997-aaf9-3501c9357535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64dc78c9-4227-4302-b554-1ddce6e67675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64dc78c9-4227-4302-b554-1ddce6e67675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7', 'volume_name': 'volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (323c51ff-7f38-4d69-abef-58ad5b4e8e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (323c51ff-7f38-4d69-abef-58ad5b4e8e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359fb54e-dd92-4eb4-a496-5669c170a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:08 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume 49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7', 'volume_size': 1} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9b4a8027-dcff-49a4-a841-36b37231c22b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:08 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9b4a8027-dcff-49a4-a841-36b37231c22b Jul 03 14:07:08 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Flow 'volume_create_manager' (d468ff50-5285-45de-b43b-cbdd140a707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7c8082-9e0d-400e-8baa-b120a412082e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7c8082-9e0d-400e-8baa-b120a412082e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1220019769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b029273a-aa51-4148-b278-1385303ced53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d0136503f1450487a462242cb0f434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:08Z,use_quota=True,user_id='af5ea4dc91724b7e8f8aec2e0bcac3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f2bdb0-7a7b-47e6-9852-594dc39787c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f2bdb0-7a7b-47e6-9852-594dc39787c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f18e65-785c-4d34-a372-a62a3756e14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f18e65-785c-4d34-a372-a62a3756e14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b029273a-aa51-4148-b278-1385303ced53', 'volume_name': 'volume-b029273a-aa51-4148-b278-1385303ced53', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a82a355-5c3e-4aaa-a9b8-8c5d96868ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a82a355-5c3e-4aaa-a9b8-8c5d96868ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c85d43f-7ea2-4b83-be9b-f8d70d74d4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:08 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume b029273a-aa51-4148-b278-1385303ced53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b029273a-aa51-4148-b278-1385303ced53', 'volume_size': 1} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:08 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9b4a8027-dcff-49a4-a841-36b37231c22b" returned: 0 in 0.659s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.398s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-605899573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50eff520-da36-4cf4-ae78-df64d2dd943b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d0136503f1450487a462242cb0f434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:07Z,use_quota=True,user_id='af5ea4dc91724b7e8f8aec2e0bcac3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Creating volume 50eff520-da36-4cf4-ae78-df64d2dd943b {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:08 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50eff520-da36-4cf4-ae78-df64d2dd943b 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74275ea-6048-403d-ab22-ba335936fa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4a8027-dcff-49a4-a841-36b37231c22b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:08 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50eff520-da36-4cf4-ae78-df64d2dd943b 1073741824 Jul 03 14:07:08 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4082c709-1a71-4893-ad4e-a13d1d274199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:08 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume volume-9b4a8027-dcff-49a4-a841-36b37231c22b (9b4a8027-dcff-49a4-a841-36b37231c22b): created successfully Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4082c709-1a71-4893-ad4e-a13d1d274199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Flow 'volume_create_manager' (727bd92e-2818-442f-8b44-6ca9d796f3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:09 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f85c99a0-c118-43fe-b9cc-b4de5e90532e tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created volume successfully. Jul 03 14:07:09 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50eff520-da36-4cf4-ae78-df64d2dd943b 1073741824" returned: 0 in 0.825s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50eff520-da36-4cf4-ae78-df64d2dd943b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:09 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50eff520-da36-4cf4-ae78-df64d2dd943b Jul 03 14:07:09 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:10 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50eff520-da36-4cf4-ae78-df64d2dd943b" returned: 0 in 0.654s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.552s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1891215414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6903791-e393-4899-a157-4faffb0ad87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d0136503f1450487a462242cb0f434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:08Z,use_quota=True,user_id='af5ea4dc91724b7e8f8aec2e0bcac3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Creating volume b6903791-e393-4899-a157-4faffb0ad87f {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:10 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6903791-e393-4899-a157-4faffb0ad87f 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29eca102-01f5-481c-8e89-327c53899f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50eff520-da36-4cf4-ae78-df64d2dd943b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:10 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6903791-e393-4899-a157-4faffb0ad87f 1073741824 Jul 03 14:07:10 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e20da0d-5381-4877-a19d-c86c4eb2ea07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:10 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume volume-50eff520-da36-4cf4-ae78-df64d2dd943b (50eff520-da36-4cf4-ae78-df64d2dd943b): created successfully Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e20da0d-5381-4877-a19d-c86c4eb2ea07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Flow 'volume_create_manager' (a2e7d0bf-c833-4de9-890d-7fe2c562eaba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:10 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c433f23e-23ff-4005-ac94-31017186710d tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created volume successfully. Jul 03 14:07:11 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6903791-e393-4899-a157-4faffb0ad87f 1073741824" returned: 0 in 0.829s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6903791-e393-4899-a157-4faffb0ad87f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:11 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6903791-e393-4899-a157-4faffb0ad87f Jul 03 14:07:11 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:11 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6903791-e393-4899-a157-4faffb0ad87f" returned: 0 in 0.626s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.710s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-833150175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d0136503f1450487a462242cb0f434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:08Z,use_quota=True,user_id='af5ea4dc91724b7e8f8aec2e0bcac3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Creating volume 49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:11 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:11 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7 1073741824 Jul 03 14:07:11 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea39701-f200-413f-8a2f-6674595722c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6903791-e393-4899-a157-4faffb0ad87f', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133a638e-5127-4bda-ab06-867308f2f208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:12 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume volume-b6903791-e393-4899-a157-4faffb0ad87f (b6903791-e393-4899-a157-4faffb0ad87f): created successfully Jul 03 14:07:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133a638e-5127-4bda-ab06-867308f2f208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:12 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Flow 'volume_create_manager' (1918e518-e7ce-4bc4-872a-0ff4f48cd1e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:12 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7a070885-2d21-4e9a-99a1-d3a9e222a8ce tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created volume successfully. Jul 03 14:07:12 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7 1073741824" returned: 0 in 0.887s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:12 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7 Jul 03 14:07:12 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-623ba4ba-c330-4a4a-b48f-5c96589cc411 req-5e02a5ed-3a98-44be-9cf2-400588e9db2a tempest-TestStampPattern-1026759899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:13 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7" returned: 0 in 0.661s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.939s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1220019769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b029273a-aa51-4148-b278-1385303ced53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d0136503f1450487a462242cb0f434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:08Z,use_quota=True,user_id='af5ea4dc91724b7e8f8aec2e0bcac3d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Creating volume b029273a-aa51-4148-b278-1385303ced53 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:13 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b029273a-aa51-4148-b278-1385303ced53 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:13 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b029273a-aa51-4148-b278-1385303ced53 1073741824 Jul 03 14:07:13 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359fb54e-dd92-4eb4-a496-5669c170a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce69e56-b129-44cf-9314-bb71b202eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:13 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7 (49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7): created successfully Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce69e56-b129-44cf-9314-bb71b202eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Flow 'volume_create_manager' (2c9518c4-037c-4135-8b1a-3b509bc40b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f0293938-47b3-4eaf-97f8-bdc21bc38a53 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created volume successfully. Jul 03 14:07:14 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b029273a-aa51-4148-b278-1385303ced53 1073741824" returned: 0 in 0.805s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b029273a-aa51-4148-b278-1385303ced53 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:14 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b029273a-aa51-4148-b278-1385303ced53 Jul 03 14:07:14 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:15 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b029273a-aa51-4148-b278-1385303ced53" returned: 0 in 0.628s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-623ba4ba-c330-4a4a-b48f-5c96589cc411 req-5e02a5ed-3a98-44be-9cf2-400588e9db2a tempest-TestStampPattern-1026759899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.524s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c85d43f-7ea2-4b83-be9b-f8d70d74d4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b029273a-aa51-4148-b278-1385303ced53', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41ddbd8-8cb4-4fbc-9256-3d32ebe34f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[413cf116-c8d5-45da-b324-0d1060bc1bcc]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-623ba4ba-c330-4a4a-b48f-5c96589cc411 req-5e02a5ed-3a98-44be-9cf2-400588e9db2a tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:15 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Volume volume-b029273a-aa51-4148-b278-1385303ced53 (b029273a-aa51-4148-b278-1385303ced53): created successfully Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41ddbd8-8cb4-4fbc-9256-3d32ebe34f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Flow 'volume_create_manager' (d468ff50-5285-45de-b43b-cbdd140a707e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:15 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1cc86be9-96e8-4e18-9036-37acfc9aeb87 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created volume successfully. Jul 03 14:07:15 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 Jul 03 14:07:15 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:15 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [req-623ba4ba-c330-4a4a-b48f-5c96589cc411 req-5e02a5ed-3a98-44be-9cf2-400588e9db2a tempest-TestStampPattern-1026759899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" returned: 0 in 0.720s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [req-623ba4ba-c330-4a4a-b48f-5c96589cc411 req-5e02a5ed-3a98-44be-9cf2-400588e9db2a tempest-TestStampPattern-1026759899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.745s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:15 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-623ba4ba-c330-4a4a-b48f-5c96589cc411 req-5e02a5ed-3a98-44be-9cf2-400588e9db2a tempest-TestStampPattern-1026759899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26', 'name': 'volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4f6dc1a-224d-4007-b69e-f82c58ad67d6', 'enforce_multipath': True} {{(pid=86729) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 14:07:15 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-623ba4ba-c330-4a4a-b48f-5c96589cc411 req-5e02a5ed-3a98-44be-9cf2-400588e9db2a tempest-TestStampPattern-1026759899 None] attachment_update completed successfully. Jul 03 14:07:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-b029273a-aa51-4148-b278-1385303ced53-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-b029273a-aa51-4148-b278-1385303ced53-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-quobyte-b029273a-aa51-4148-b278-1385303ced53" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-b029273a-aa51-4148-b278-1385303ced53" acquired by "delete_volume" :: waited 0.013s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:16 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea19a222-844a-48ba-86fa-c16c4677a066]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b029273a-aa51-4148-b278-1385303ced53 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:16 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b029273a-aa51-4148-b278-1385303ced53 Jul 03 14:07:16 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:17 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b029273a-aa51-4148-b278-1385303ced53" returned: 0 in 0.759s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b029273a-aa51-4148-b278-1385303ced53 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:17 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b029273a-aa51-4148-b278-1385303ced53 Jul 03 14:07:17 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:17 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b029273a-aa51-4148-b278-1385303ced53" returned: 0 in 0.651s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-b029273a-aa51-4148-b278-1385303ced53" released by "delete_volume" :: held 1.448s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:17 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created reservations ['e5a3f96f-6e8a-491a-9902-23f7222cfd2e', '37ec2934-057e-4d2d-8ff1-4dc19e345a52', '9e66e8a7-5f33-46a2-b38d-63aad130bd70', '21eb65aa-3f62-4a39-aa5f-a6759a2cb33d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:17 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:07:17 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:18 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.639s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:18 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:18 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Deleted volume successfully. Jul 03 14:07:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-quobyte-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6684f5c8-64dd-4253-9a47-79f490f84ce9 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-b029273a-aa51-4148-b278-1385303ced53-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:18 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2278846-f0b8-4023-881e-9b97b0f84e96]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:18 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7 Jul 03 14:07:18 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:19 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7" returned: 0 in 0.751s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:19 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7 Jul 03 14:07:19 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:19 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7" returned: 0 in 0.619s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7" released by "delete_volume" :: held 1.410s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:19 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created reservations ['a29755d7-f470-494a-8a2f-8c1b7a9aed31', '678be20b-c37f-4f4c-aba9-9d42b3cb3781', '9e2f8fe1-d0fc-4bad-96ea-9e4b6185ff01', 'c6b7bc1b-3674-49d2-9d9b-5c70cdcb48de'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:20 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:07:20 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-b6903791-e393-4899-a157-4faffb0ad87f-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-b6903791-e393-4899-a157-4faffb0ad87f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:20 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.674s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-quobyte-b6903791-e393-4899-a157-4faffb0ad87f" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:20 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Deleted volume successfully. Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-b6903791-e393-4899-a157-4faffb0ad87f" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8973f7fd-2446-4b12-b4bb-2ae4617b7653 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-49e4ed9d-a5bb-42e8-b3c7-43a5b1b48ba7-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d4bacd-f8f3-422b-a31b-9071a149ff62]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6903791-e393-4899-a157-4faffb0ad87f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:20 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6903791-e393-4899-a157-4faffb0ad87f Jul 03 14:07:20 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:21 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6903791-e393-4899-a157-4faffb0ad87f" returned: 0 in 0.804s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6903791-e393-4899-a157-4faffb0ad87f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:21 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6903791-e393-4899-a157-4faffb0ad87f Jul 03 14:07:21 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:22 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6903791-e393-4899-a157-4faffb0ad87f" returned: 0 in 0.644s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-b6903791-e393-4899-a157-4faffb0ad87f" released by "delete_volume" :: held 1.492s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:22 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created reservations ['41922807-2c47-4330-bd40-c14c25a8a395', '1582ed35-2ea2-4603-847b-733d08ff5d8f', '7a67567f-bfe0-4262-b6fe-cc638433c923', '586a004b-57e2-47ff-80e2-7f88f0f99f0a'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:22 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:07:22 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:22 devstack cinder-volume[86729]: INFO cinder.volume.manager [req-01de6fd1-c304-4182-b995-152ebdca4efa req-04a8a056-111e-44b5-bd07-1a1361ea1137 tempest-TestStampPattern-1026759899 None] Terminate volume connection completed successfully. Jul 03 14:07:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [req-01de6fd1-c304-4182-b995-152ebdca4efa req-04a8a056-111e-44b5-bd07-1a1361ea1137 tempest-TestStampPattern-1026759899 None] Deleting attachment a4f6dc1a-224d-4007-b69e-f82c58ad67d6. {{(pid=86729) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 14:07:23 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.665s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:23 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:23 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Deleted volume successfully. Jul 03 14:07:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e92290ae-c16c-4de8-a7ac-f83ef74f7eea tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-b6903791-e393-4899-a157-4faffb0ad87f-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-50eff520-da36-4cf4-ae78-df64d2dd943b-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-50eff520-da36-4cf4-ae78-df64d2dd943b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-quobyte-50eff520-da36-4cf4-ae78-df64d2dd943b" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-50eff520-da36-4cf4-ae78-df64d2dd943b" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[927e8825-5236-4e57-bf69-5940ce185a62]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50eff520-da36-4cf4-ae78-df64d2dd943b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:23 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50eff520-da36-4cf4-ae78-df64d2dd943b Jul 03 14:07:23 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:23 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50eff520-da36-4cf4-ae78-df64d2dd943b" returned: 0 in 0.733s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50eff520-da36-4cf4-ae78-df64d2dd943b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:23 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50eff520-da36-4cf4-ae78-df64d2dd943b Jul 03 14:07:23 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:24 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50eff520-da36-4cf4-ae78-df64d2dd943b" returned: 0 in 0.620s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:24 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-50eff520-da36-4cf4-ae78-df64d2dd943b" released by "delete_volume" :: held 1.390s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:24 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created reservations ['56665fd1-5e39-44f6-ba70-f0ef97a65dcf', '3e41dea3-6400-439b-a75c-f721ea527961', 'd2b558ae-6e28-40ef-9712-bd5a55b594d0', 'ca3865d3-177c-468f-8314-ba3d97c542dc'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:24 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:07:24 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-9b4a8027-dcff-49a4-a841-36b37231c22b-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:25 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.724s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:25 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:25 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Deleted volume successfully. Jul 03 14:07:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-9b4a8027-dcff-49a4-a841-36b37231c22b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-eb05ffec-c672-4298-8acb-a5de4736284a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-50eff520-da36-4cf4-ae78-df64d2dd943b-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-quobyte-9b4a8027-dcff-49a4-a841-36b37231c22b" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-9b4a8027-dcff-49a4-a841-36b37231c22b" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:25 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[679b0cfd-a019-4324-ae72-bc0c0246dc5f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9b4a8027-dcff-49a4-a841-36b37231c22b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:25 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9b4a8027-dcff-49a4-a841-36b37231c22b Jul 03 14:07:25 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:07:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:26 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:07:26 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:26 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9b4a8027-dcff-49a4-a841-36b37231c22b" returned: 0 in 0.817s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9b4a8027-dcff-49a4-a841-36b37231c22b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:26 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9b4a8027-dcff-49a4-a841-36b37231c22b Jul 03 14:07:26 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:26 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.698s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:27 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9b4a8027-dcff-49a4-a841-36b37231c22b" returned: 0 in 0.730s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-9b4a8027-dcff-49a4-a841-36b37231c22b" released by "delete_volume" :: held 1.608s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created reservations ['0ac91cd3-157d-4236-98d8-7ea6f10e1cf0', '9e155fc2-5f12-40a9-b802-7c23921ded5f', 'd1ce29e3-2d8e-431d-b48f-9b18ffe11748', 'd133aa18-878e-442d-bc65-56ecb828efa8'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:27 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:07:27 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-31930f2c-c8f9-493c-b091-fd91f78de24b-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-31930f2c-c8f9-493c-b091-fd91f78de24b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-quobyte-e587bc79-e2f2-434b-b0c3-dc3139f44849" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-e587bc79-e2f2-434b-b0c3-dc3139f44849" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-quobyte-31930f2c-c8f9-493c-b091-fd91f78de24b" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-31930f2c-c8f9-493c-b091-fd91f78de24b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Deleting offline snapshot 31930f2c-c8f9-493c-b091-fd91f78de24b of volume e587bc79-e2f2-434b-b0c3-dc3139f44849 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] snapshot_file for this snap is: volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e4e871-af6b-45d8-9662-f4080a1e219e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:27 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b Jul 03 14:07:27 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:27 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.725s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:27 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:27 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Deleted volume successfully. Jul 03 14:07:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1dc4dee7-6b65-49c1-b99e-8a86d5d4fa24 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-9b4a8027-dcff-49a4-a841-36b37231c22b-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:28 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b" returned: 0 in 0.788s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:28 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e587bc79-e2f2-434b-b0c3-dc3139f44849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:07:28 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[12314fcd-e200-450b-8833-be31d7df881a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:28 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 Jul 03 14:07:28 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:29 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849" returned: 0 in 0.752s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:29 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b Jul 03 14:07:29 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:30 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b" returned: 0 in 0.713s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:30 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b Jul 03 14:07:30 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:30 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849.31930f2c-c8f9-493c-b091-fd91f78de24b" returned: 0 in 0.623s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-31930f2c-c8f9-493c-b091-fd91f78de24b" released by "_delete_snapshot" :: held 3.013s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-e587bc79-e2f2-434b-b0c3-dc3139f44849" released by "delete_snapshot" :: held 3.040s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:30 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created reservations ['6370e667-6825-463e-8962-3a1273812930', '52e5bd10-00e5-4e3f-9458-fd15c10c5e60', '8348149f-148a-4943-b702-54b459098335', 'b014538e-a5c2-4864-8a2e-1979275f7886'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:30 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Delete snapshot completed successfully. Jul 03 14:07:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-af968e92-0ef4-41bf-8ec4-7fb34c6cfbb6 tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-31930f2c-c8f9-493c-b091-fd91f78de24b-delete_snapshot" released by "delete_snapshot" :: held 3.190s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-e587bc79-e2f2-434b-b0c3-dc3139f44849-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-e587bc79-e2f2-434b-b0c3-dc3139f44849-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "cinder-quobyte-e587bc79-e2f2-434b-b0c3-dc3139f44849" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-e587bc79-e2f2-434b-b0c3-dc3139f44849" acquired by "delete_volume" :: waited 0.013s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0697e2-cd7f-44b8-b141-ab93b9841e29]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Acquiring lock "cinder-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Lock "cinder-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Acquiring lock "cinder-quobyte-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Lock "cinder-quobyte-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" acquired by "delete_volume" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:32 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 Jul 03 14:07:32 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd076e21-a1bf-46c3-9f16-c0e3b8e5eaf6]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:32 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 Jul 03 14:07:32 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:32 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849" returned: 0 in 0.760s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:32 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849 Jul 03 14:07:32 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:32 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" returned: 0 in 0.741s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:32 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1 Jul 03 14:07:32 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:33 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e587bc79-e2f2-434b-b0c3-dc3139f44849" returned: 0 in 0.641s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-quobyte-e587bc79-e2f2-434b-b0c3-dc3139f44849" released by "delete_volume" :: held 1.464s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Created reservations ['ee3934cb-9df2-45a4-a44b-6810b0ab68b5', '828eaaa1-0fed-4b43-90d3-8f77f67add61', '90181d6b-aa4f-4c5a-819e-245654aad284', '3c3a2a14-9222-470a-ac5f-710c5d3b2b03'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:33 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" returned: 0 in 0.651s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Lock "cinder-quobyte-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1" released by "delete_volume" :: held 1.447s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:33 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:07:33 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Created reservations ['4a782322-f7dc-45fa-9677-99f2c5b0aec3', '4e60eb5f-d8b9-4819-b722-e61378d48fed', 'cc61290b-1a7c-4f78-846d-b019b8f944a7', '601630a9-1dae-4601-a82d-d71f7809ebf8'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:33 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:07:33 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:34 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.646s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Deleted volume successfully. Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-61aef8df-f333-499d-98d1-437d1d05c53a tempest-CreateVolumesFromSnapshotTest-1256902343 None] Lock "cinder-e587bc79-e2f2-434b-b0c3-dc3139f44849-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:34 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.656s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Deleted volume successfully. Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-626c87c8-697c-4f50-a2be-564f81f04880 tempest-TestStampPattern-1026759899 None] Lock "cinder-fa96bf6a-4e42-433b-bf8a-e76bcb8b91b1-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Acquiring lock "cinder-c44c9d93-34a9-4b53-bfb0-979274def6f4-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Lock "cinder-c44c9d93-34a9-4b53-bfb0-979274def6f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Acquiring lock "cinder-quobyte-4050d8aa-0403-475e-b844-a93183e2c34c" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Lock "cinder-quobyte-4050d8aa-0403-475e-b844-a93183e2c34c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Acquiring lock "cinder-quobyte-c44c9d93-34a9-4b53-bfb0-979274def6f4" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Lock "cinder-quobyte-c44c9d93-34a9-4b53-bfb0-979274def6f4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Deleting offline snapshot c44c9d93-34a9-4b53-bfb0-979274def6f4 of volume 4050d8aa-0403-475e-b844-a93183e2c34c {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] snapshot_file for this snap is: volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[45db1263-7c76-4e3d-8340-47b8964d8fed]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:34 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 Jul 03 14:07:34 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:35 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4" returned: 0 in 0.839s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4050d8aa-0403-475e-b844-a93183e2c34c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:07:35 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f8f37c-a6be-4a62-8727-4474a4626a4f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:35 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c Jul 03 14:07:35 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:36 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c" returned: 0 in 0.789s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:36 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 Jul 03 14:07:36 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=81,cinder:UPDATE=96,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=72,cinder:INSERT=24,cinder:UPDATE=96,cinder:DELETE=7 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Flow 'volume_create_manager' (bc3fb5e7-7ef9-4be5-af44-ce45aa503bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8605ea0d-27b1-441a-96ef-fd92610df74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8605ea0d-27b1-441a-96ef-fd92610df74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50fe1c8a-0a72-4216-8337-b4e24cd59bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b21aa02e2dd4432b9684ee661e1a21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:37Z,use_quota=True,user_id='6feef8942e4346fbafe47a715ccfd282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981712b6-ae97-4b00-82ec-7b423cea0743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981712b6-ae97-4b00-82ec-7b423cea0743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5774ed77-402e-4025-91ca-a41ab7d2047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5774ed77-402e-4025-91ca-a41ab7d2047d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50fe1c8a-0a72-4216-8337-b4e24cd59bef', 'volume_name': 'volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6506e2b7-9ba4-4f90-9af5-ec99dfe2c897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6506e2b7-9ba4-4f90-9af5-ec99dfe2c897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:37 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0ae229-1c44-41a9-8b6c-af96d60ab13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:37 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Volume 50fe1c8a-0a72-4216-8337-b4e24cd59bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef', 'volume_size': 1} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50fe1c8a-0a72-4216-8337-b4e24cd59bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b21aa02e2dd4432b9684ee661e1a21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:37Z,use_quota=True,user_id='6feef8942e4346fbafe47a715ccfd282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Creating volume 50fe1c8a-0a72-4216-8337-b4e24cd59bef {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:37 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4" returned: 0 in 0.826s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:37 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef 1073741824 Jul 03 14:07:37 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:37 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4 Jul 03 14:07:37 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:37 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c.c44c9d93-34a9-4b53-bfb0-979274def6f4" returned: 0 in 0.657s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Lock "cinder-quobyte-c44c9d93-34a9-4b53-bfb0-979274def6f4" released by "_delete_snapshot" :: held 3.222s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Lock "cinder-quobyte-4050d8aa-0403-475e-b844-a93183e2c34c" released by "delete_snapshot" :: held 3.247s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:37 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Created reservations ['3df2ece3-7104-49d7-850f-362713da43a9', '3602e530-e0ee-4ee7-ba73-8f566f1dfd58', '8c97903c-6c54-47d9-a25a-c48ae946bb94', 'd8acea3a-e68d-4ee5-b54d-2900069ba431'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Delete snapshot completed successfully. Jul 03 14:07:38 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-280832c9-818d-43da-99c2-f3bc0a0a25b4 tempest-TestStampPattern-1026759899 None] Lock "cinder-c44c9d93-34a9-4b53-bfb0-979274def6f4-delete_snapshot" released by "delete_snapshot" :: held 3.416s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef 1073741824" returned: 0 in 0.881s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:38 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef Jul 03 14:07:38 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:38 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef" returned: 0 in 0.601s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0ae229-1c44-41a9-8b6c-af96d60ab13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec1b813-19a5-4aaf-8a79-f29de2501460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:38 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Volume volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef (50fe1c8a-0a72-4216-8337-b4e24cd59bef): created successfully Jul 03 14:07:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec1b813-19a5-4aaf-8a79-f29de2501460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Flow 'volume_create_manager' (bc3fb5e7-7ef9-4be5-af44-ce45aa503bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e7d8c0d9-ccb6-4685-971c-66dfd588a133 tempest-CinderUnicodeTest-1765458945 None] Created volume successfully. Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Flow 'volume_create_manager' (ecb408a3-1173-418b-a1c3-bec06172ff44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8b25ce-92d3-498b-b2de-456a2b9ad9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8b25ce-92d3-498b-b2de-456a2b9ad9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1849560982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649da24b-6c6c-46a0-aa6a-ae659c0d1807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b21aa02e2dd4432b9684ee661e1a21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:40Z,use_quota=True,user_id='6feef8942e4346fbafe47a715ccfd282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c915f12-d55e-4758-88a5-697b47896427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c915f12-d55e-4758-88a5-697b47896427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cb5539-90f3-47da-8c90-f08183af1256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cb5539-90f3-47da-8c90-f08183af1256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '649da24b-6c6c-46a0-aa6a-ae659c0d1807', 'volume_name': 'volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b5c891-b073-45f8-a28a-5a01d4fbf92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b5c891-b073-45f8-a28a-5a01d4fbf92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6665475-276e-447c-bc4c-00e31ff4d57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:39 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Volume 649da24b-6c6c-46a0-aa6a-ae659c0d1807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807', 'volume_size': 1} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:07:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1849560982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649da24b-6c6c-46a0-aa6a-ae659c0d1807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b21aa02e2dd4432b9684ee661e1a21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:07:40Z,use_quota=True,user_id='6feef8942e4346fbafe47a715ccfd282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Creating volume 649da24b-6c6c-46a0-aa6a-ae659c0d1807 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:07:39 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:07:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:39 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 1073741824 Jul 03 14:07:39 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:40 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 1073741824" returned: 0 in 0.854s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:40 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 Jul 03 14:07:40 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:41 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807" returned: 0 in 0.894s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:07:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6665475-276e-447c-bc4c-00e31ff4d57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5270d1d5-03b4-4575-813c-9a0dcd13e731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:07:41 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Volume volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 (649da24b-6c6c-46a0-aa6a-ae659c0d1807): created successfully Jul 03 14:07:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5270d1d5-03b4-4575-813c-9a0dcd13e731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:07:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Flow 'volume_create_manager' (ecb408a3-1173-418b-a1c3-bec06172ff44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:07:41 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a6ea3bf0-10a7-44b8-baac-7af48500ecc8 tempest-CinderUnicodeTest-1765458945 None] Created volume successfully. Jul 03 14:07:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] Creating offline snapshot e4ada3f7-2ac0-4730-b177-3c6c422d0ace of volume 649da24b-6c6c-46a0-aa6a-ae659c0d1807 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:07:43 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a710379-cbf7-4a36-8390-dc288ec59319]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:43 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 Jul 03 14:07:43 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:43 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807" returned: 0 in 0.749s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:43 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace 1G Jul 03 14:07:43 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:44 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace 1G" returned: 0 in 0.790s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:44 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace Jul 03 14:07:44 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:45 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace" returned: 0 in 0.686s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:45 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace is being set with open permissions: ugo+rw Jul 03 14:07:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:45 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace Jul 03 14:07:45 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:45 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace" returned: 0 in 0.624s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:46 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.info Jul 03 14:07:46 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:46 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.info" returned: 0 in 0.665s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:46 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.info is being set with open permissions: ugo+rw Jul 03 14:07:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:46 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.info Jul 03 14:07:46 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:47 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.info" returned: 0 in 0.674s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.270s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:47 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e150e18e-97f2-4fc8-99f7-bee5cfe47450 tempest-CinderUnicodeTest-1765458945 None] Create snapshot completed successfully Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Acquiring lock "cinder-4050d8aa-0403-475e-b844-a93183e2c34c-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Lock "cinder-4050d8aa-0403-475e-b844-a93183e2c34c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Acquiring lock "cinder-quobyte-4050d8aa-0403-475e-b844-a93183e2c34c" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Lock "cinder-quobyte-4050d8aa-0403-475e-b844-a93183e2c34c" acquired by "delete_volume" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af1b654-143a-4e91-8002-490767e265c2]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "cinder-e4ada3f7-2ac0-4730-b177-3c6c422d0ace-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-e4ada3f7-2ac0-4730-b177-3c6c422d0ace-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "cinder-quobyte-649da24b-6c6c-46a0-aa6a-ae659c0d1807" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-quobyte-649da24b-6c6c-46a0-aa6a-ae659c0d1807" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "cinder-quobyte-e4ada3f7-2ac0-4730-b177-3c6c422d0ace" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-quobyte-e4ada3f7-2ac0-4730-b177-3c6c422d0ace" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Deleting offline snapshot e4ada3f7-2ac0-4730-b177-3c6c422d0ace of volume 649da24b-6c6c-46a0-aa6a-ae659c0d1807 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] snapshot_file for this snap is: volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7040760-6f15-418e-8405-6eb79d06c1bd]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:48 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c Jul 03 14:07:48 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:48 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace Jul 03 14:07:48 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:49 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c" returned: 0 in 0.764s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:49 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c Jul 03 14:07:49 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:49 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace" returned: 0 in 0.736s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9209d4-8d65-4dde-8319-8e022228bad8]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:49 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 Jul 03 14:07:49 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:49 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4050d8aa-0403-475e-b844-a93183e2c34c" returned: 0 in 0.654s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Lock "cinder-quobyte-4050d8aa-0403-475e-b844-a93183e2c34c" released by "delete_volume" :: held 1.483s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Created reservations ['624dd7cf-1c47-452c-a29b-07d1bb78c5fb', '7fd57848-967e-481f-a313-ef1acdea98e5', '2e6bd028-69fd-40ee-906b-4b264b40cd9f', 'f6808b9b-c487-49bd-8f00-0943caeef6f3'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:49 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:07:49 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:49 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807" returned: 0 in 0.752s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:50 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace Jul 03 14:07:50 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:50 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.657s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:50 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Deleted volume successfully. Jul 03 14:07:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-510303a2-e094-4366-b4c8-4780cb0a3790 tempest-TestStampPattern-1026759899 None] Lock "cinder-4050d8aa-0403-475e-b844-a93183e2c34c-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace" returned: 0 in 0.772s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:50 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:50 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace Jul 03 14:07:50 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:51 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807.e4ada3f7-2ac0-4730-b177-3c6c422d0ace" returned: 0 in 0.696s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-quobyte-e4ada3f7-2ac0-4730-b177-3c6c422d0ace" released by "_delete_snapshot" :: held 3.054s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-quobyte-649da24b-6c6c-46a0-aa6a-ae659c0d1807" released by "delete_snapshot" :: held 3.080s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:51 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Created reservations ['a91d3d50-799f-44e5-b947-758cdcf9bcf0', '6e7f2ff3-bf2f-447c-b653-33d4427bdd6e', 'b14d43b8-d183-42a2-a9c1-a9dd8689218f', '58d29af1-dfdc-4245-80ac-189aa2bc2565'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:51 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Delete snapshot completed successfully. Jul 03 14:07:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-723ef79c-3ebd-4577-8abc-488e21136926 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-e4ada3f7-2ac0-4730-b177-3c6c422d0ace-delete_snapshot" released by "delete_snapshot" :: held 3.230s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "cinder-649da24b-6c6c-46a0-aa6a-ae659c0d1807-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-649da24b-6c6c-46a0-aa6a-ae659c0d1807-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "cinder-quobyte-649da24b-6c6c-46a0-aa6a-ae659c0d1807" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-quobyte-649da24b-6c6c-46a0-aa6a-ae659c0d1807" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:52 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef02913-4454-4df6-8fd5-0fcb1d9dc958]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:52 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 Jul 03 14:07:52 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:53 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807" returned: 0 in 0.806s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:53 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807 Jul 03 14:07:53 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:54 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-649da24b-6c6c-46a0-aa6a-ae659c0d1807" returned: 0 in 0.785s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-quobyte-649da24b-6c6c-46a0-aa6a-ae659c0d1807" released by "delete_volume" :: held 1.664s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:54 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Created reservations ['f9d65af9-ba40-4e8c-a1fb-48491c403898', '48940cba-2351-4b0a-8a2e-eca922ea6481', '3dd3d47e-5f77-4613-a8e9-0b3bdadca4fe', '1dde4207-5d25-4274-b6fe-6d2c7ca386cf'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:54 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:07:54 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "cinder-50fe1c8a-0a72-4216-8337-b4e24cd59bef-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-50fe1c8a-0a72-4216-8337-b4e24cd59bef-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "cinder-quobyte-50fe1c8a-0a72-4216-8337-b4e24cd59bef" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:07:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-quobyte-50fe1c8a-0a72-4216-8337-b4e24cd59bef" acquired by "delete_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:07:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac97287-c3ab-4abc-b1f4-f14b32a6b7b7]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:07:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:55 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef Jul 03 14:07:55 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:55 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.809s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:55 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:55 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Deleted volume successfully. Jul 03 14:07:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7cc35202-d5bb-40a7-a3ae-5b330e4a8d04 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-649da24b-6c6c-46a0-aa6a-ae659c0d1807-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:55 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef" returned: 0 in 0.820s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:55 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef Jul 03 14:07:55 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:56 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50fe1c8a-0a72-4216-8337-b4e24cd59bef" returned: 0 in 0.685s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-quobyte-50fe1c8a-0a72-4216-8337-b4e24cd59bef" released by "delete_volume" :: held 1.561s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:07:56 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Created reservations ['b3ebca00-eadb-4a67-8a8a-800e63d40a97', 'aec9c93e-bf97-4c67-b6ed-23707ce70598', '5f45b24c-f86b-4ca7-a010-b6ab6c3cd6d5', '272d247e-8191-4f13-a815-f520ec165fe5'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:07:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:07:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:07:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:07:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:07:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:07:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:07:56 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:07:56 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:07:57 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 03 14:07:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.671s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:07:57 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:07:57 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Deleted volume successfully. Jul 03 14:07:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-8b9d5dc8-7bb7-4168-ab11-600075b7e6a9 tempest-CinderUnicodeTest-1765458945 None] Lock "cinder-50fe1c8a-0a72-4216-8337-b4e24cd59bef-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Flow 'volume_create_manager' (dab49e3a-5a59-450d-9c2a-5c7e759a7cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fff495c-c0db-487a-a50b-61d6d9091bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fff495c-c0db-487a-a50b-61d6d9091bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850528140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e2b842-c611-4c82-8242-a9d2a413538a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7b4d2d2a694382a7f129c013734716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:02Z,use_quota=True,user_id='20b1b7ca103045ab84e4e007ee65572d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7ec23f-6058-46e3-ae03-35c48b84deaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7ec23f-6058-46e3-ae03-35c48b84deaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658e797c-65ec-4aeb-b3f9-535b8d7796eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658e797c-65ec-4aeb-b3f9-535b8d7796eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e2b842-c611-4c82-8242-a9d2a413538a', 'volume_name': 'volume-50e2b842-c611-4c82-8242-a9d2a413538a', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bc0820-979b-435f-8b42-8d21c7605231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bc0820-979b-435f-8b42-8d21c7605231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9825ab9-a9b0-4beb-84f4-4bb00815d383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:01 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Volume 50e2b842-c611-4c82-8242-a9d2a413538a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e2b842-c611-4c82-8242-a9d2a413538a', 'volume_size': 1} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850528140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e2b842-c611-4c82-8242-a9d2a413538a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7b4d2d2a694382a7f129c013734716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:02Z,use_quota=True,user_id='20b1b7ca103045ab84e4e007ee65572d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Creating volume 50e2b842-c611-4c82-8242-a9d2a413538a {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:01 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50e2b842-c611-4c82-8242-a9d2a413538a 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:01 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50e2b842-c611-4c82-8242-a9d2a413538a 1073741824 Jul 03 14:08:01 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Flow 'volume_create_manager' (e28b6f0d-f228-44a0-bcfd-63b195798665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ce5af2-0557-441b-83cb-15b1862e91ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ce5af2-0557-441b-83cb-15b1862e91ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220649031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790c9873-d039-4d3a-9815-281ea0722373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac96104bc4e447aa7632b53322844bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:03Z,use_quota=True,user_id='e383f36f3f414c02b5876deb1914732d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbb51c3-2a6e-4c5a-bd1e-8fb136dca919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbb51c3-2a6e-4c5a-bd1e-8fb136dca919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edfd8a1-fcb8-4ef0-bb5d-76d6829a774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:02 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edfd8a1-fcb8-4ef0-bb5d-76d6829a774f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790c9873-d039-4d3a-9815-281ea0722373', 'volume_name': 'volume-790c9873-d039-4d3a-9815-281ea0722373', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ea9711-1cae-4724-9fce-f0a2ab9883b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ea9711-1cae-4724-9fce-f0a2ab9883b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb68411-b8c0-4730-96d1-6264d5ee5ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:02 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Volume 790c9873-d039-4d3a-9815-281ea0722373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790c9873-d039-4d3a-9815-281ea0722373', 'volume_size': 1} Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50e2b842-c611-4c82-8242-a9d2a413538a 1073741824" returned: 0 in 0.957s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50e2b842-c611-4c82-8242-a9d2a413538a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:02 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50e2b842-c611-4c82-8242-a9d2a413538a Jul 03 14:08:02 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:03 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50e2b842-c611-4c82-8242-a9d2a413538a" returned: 0 in 0.636s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220649031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790c9873-d039-4d3a-9815-281ea0722373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac96104bc4e447aa7632b53322844bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:03Z,use_quota=True,user_id='e383f36f3f414c02b5876deb1914732d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Creating volume 790c9873-d039-4d3a-9815-281ea0722373 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:03 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-790c9873-d039-4d3a-9815-281ea0722373 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9825ab9-a9b0-4beb-84f4-4bb00815d383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e2b842-c611-4c82-8242-a9d2a413538a', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:03 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-790c9873-d039-4d3a-9815-281ea0722373 1073741824 Jul 03 14:08:03 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af13bbcb-943f-4787-9363-7ebf0068f6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:03 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Volume volume-50e2b842-c611-4c82-8242-a9d2a413538a (50e2b842-c611-4c82-8242-a9d2a413538a): created successfully Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af13bbcb-943f-4787-9363-7ebf0068f6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Flow 'volume_create_manager' (dab49e3a-5a59-450d-9c2a-5c7e759a7cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:03 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7507b339-984a-4c6d-8e46-53bfb863f0e2 tempest-ProjectReaderTests-2096725719 None] Created volume successfully. Jul 03 14:08:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "cinder-50e2b842-c611-4c82-8242-a9d2a413538a-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Lock "cinder-50e2b842-c611-4c82-8242-a9d2a413538a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "cinder-quobyte-50e2b842-c611-4c82-8242-a9d2a413538a" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Lock "cinder-quobyte-50e2b842-c611-4c82-8242-a9d2a413538a" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:04 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed81265-078e-47a1-8f94-f420f8f98fff]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50e2b842-c611-4c82-8242-a9d2a413538a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:04 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50e2b842-c611-4c82-8242-a9d2a413538a Jul 03 14:08:04 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:04 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-790c9873-d039-4d3a-9815-281ea0722373 1073741824" returned: 0 in 0.828s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-790c9873-d039-4d3a-9815-281ea0722373 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:04 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-790c9873-d039-4d3a-9815-281ea0722373 Jul 03 14:08:04 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:04 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50e2b842-c611-4c82-8242-a9d2a413538a" returned: 0 in 0.746s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50e2b842-c611-4c82-8242-a9d2a413538a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:04 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50e2b842-c611-4c82-8242-a9d2a413538a Jul 03 14:08:04 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:05 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-790c9873-d039-4d3a-9815-281ea0722373" returned: 0 in 0.683s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb68411-b8c0-4730-96d1-6264d5ee5ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790c9873-d039-4d3a-9815-281ea0722373', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331b3581-006b-420e-b171-e2aff8f36384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:05 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Volume volume-790c9873-d039-4d3a-9815-281ea0722373 (790c9873-d039-4d3a-9815-281ea0722373): created successfully Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331b3581-006b-420e-b171-e2aff8f36384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Flow 'volume_create_manager' (e28b6f0d-f228-44a0-bcfd-63b195798665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-59388c44-5083-4808-a53d-c8becd903a17 tempest-ProjectReaderTests-181872585 None] Created volume successfully. Jul 03 14:08:05 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-50e2b842-c611-4c82-8242-a9d2a413538a" returned: 0 in 0.630s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Lock "cinder-quobyte-50e2b842-c611-4c82-8242-a9d2a413538a" released by "delete_volume" :: held 1.414s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Created reservations ['6aaa3ed9-aa6e-404e-b390-0798d2922657', '9d8703aa-7b65-4f3f-8d9d-733cedb8c622', 'b006e2c1-452a-44bd-a92c-c9351a3736bd', '85b90b68-f77e-42d1-bdfb-865b46a29ef2'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:05 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:08:05 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Acquiring lock "cinder-790c9873-d039-4d3a-9815-281ea0722373-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Lock "cinder-790c9873-d039-4d3a-9815-281ea0722373-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Acquiring lock "cinder-quobyte-790c9873-d039-4d3a-9815-281ea0722373" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Lock "cinder-quobyte-790c9873-d039-4d3a-9815-281ea0722373" acquired by "delete_volume" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[81053b58-dcc3-41bf-b18f-0f6bb420fa23]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-790c9873-d039-4d3a-9815-281ea0722373 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:06 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-790c9873-d039-4d3a-9815-281ea0722373 Jul 03 14:08:06 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:06 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.720s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:06 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Deleted volume successfully. Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7b5d7985-6c6d-42ca-9484-723eff247cc4 tempest-ProjectReaderTests-2096725719 None] Lock "cinder-50e2b842-c611-4c82-8242-a9d2a413538a-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Flow 'volume_create_manager' (8e71ea5b-8728-47f5-bcf1-e0e8c0c81e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4332e8-d03b-4086-9f11-84f1d06b9c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4332e8-d03b-4086-9f11-84f1d06b9c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1732374883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a800faf6-1789-45bf-a75b-c2c23020ebc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7b4d2d2a694382a7f129c013734716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:07Z,use_quota=True,user_id='20b1b7ca103045ab84e4e007ee65572d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b687385-4930-45ea-aede-49b941a648bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b687385-4930-45ea-aede-49b941a648bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7d25f4-b601-4e78-8669-af07574d833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7d25f4-b601-4e78-8669-af07574d833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a800faf6-1789-45bf-a75b-c2c23020ebc0', 'volume_name': 'volume-a800faf6-1789-45bf-a75b-c2c23020ebc0', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd1cf1d-ca36-4614-917f-fe1d9cc19a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd1cf1d-ca36-4614-917f-fe1d9cc19a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a720d861-ee10-4392-9e9d-2ca9ccbbb261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:06 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Volume a800faf6-1789-45bf-a75b-c2c23020ebc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a800faf6-1789-45bf-a75b-c2c23020ebc0', 'volume_size': 1} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1732374883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a800faf6-1789-45bf-a75b-c2c23020ebc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7b4d2d2a694382a7f129c013734716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:07Z,use_quota=True,user_id='20b1b7ca103045ab84e4e007ee65572d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Creating volume a800faf6-1789-45bf-a75b-c2c23020ebc0 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:06 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a800faf6-1789-45bf-a75b-c2c23020ebc0 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:06 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a800faf6-1789-45bf-a75b-c2c23020ebc0 1073741824 Jul 03 14:08:06 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:06 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-790c9873-d039-4d3a-9815-281ea0722373" returned: 0 in 0.809s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-790c9873-d039-4d3a-9815-281ea0722373 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:06 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-790c9873-d039-4d3a-9815-281ea0722373 Jul 03 14:08:06 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:07 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-790c9873-d039-4d3a-9815-281ea0722373" returned: 0 in 0.744s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Lock "cinder-quobyte-790c9873-d039-4d3a-9815-281ea0722373" released by "delete_volume" :: held 1.603s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:07 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a800faf6-1789-45bf-a75b-c2c23020ebc0 1073741824" returned: 0 in 0.887s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:07 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Created reservations ['0d8789b1-2d24-44bd-b02b-0b46329fc149', '028e78a2-1a8a-4e73-bac3-407d10abb3c2', '0a41f5f2-d4fb-463d-b3c5-e87cd9742792', 'b0311dc5-dfd2-42f7-ac4d-a5401baa50af'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a800faf6-1789-45bf-a75b-c2c23020ebc0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:07 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a800faf6-1789-45bf-a75b-c2c23020ebc0 Jul 03 14:08:07 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:07 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:08:07 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:08 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a800faf6-1789-45bf-a75b-c2c23020ebc0" returned: 0 in 0.681s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a720d861-ee10-4392-9e9d-2ca9ccbbb261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a800faf6-1789-45bf-a75b-c2c23020ebc0', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b27958a-3d92-46ec-9c23-7fd14c241851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:08 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.663s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:08 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Deleted volume successfully. Jul 03 14:08:08 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Volume volume-a800faf6-1789-45bf-a75b-c2c23020ebc0 (a800faf6-1789-45bf-a75b-c2c23020ebc0): created successfully Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b27958a-3d92-46ec-9c23-7fd14c241851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Flow 'volume_create_manager' (8e71ea5b-8728-47f5-bcf1-e0e8c0c81e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:08 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9a79d4cc-7669-4961-96bf-b366ece7ab8c tempest-ProjectReaderTests-2096725719 None] Created volume successfully. Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c0f3af31-ea01-4e70-9ad4-d306fa5706db tempest-ProjectReaderTests-181872585 None] Lock "cinder-790c9873-d039-4d3a-9815-281ea0722373-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Flow 'volume_create_manager' (f1c6df52-8e3b-4824-80c9-971054af6823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70da70d-5fdd-4ca4-ab09-e58811394066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70da70d-5fdd-4ca4-ab09-e58811394066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139193211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f562b3-2fe3-4f35-ba64-284140265b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac96104bc4e447aa7632b53322844bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:09Z,use_quota=True,user_id='e383f36f3f414c02b5876deb1914732d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f516ea6-89c3-481c-a789-ea41ba66901f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f516ea6-89c3-481c-a789-ea41ba66901f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79842b5-7710-4144-8036-8ec3e653a0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79842b5-7710-4144-8036-8ec3e653a0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f562b3-2fe3-4f35-ba64-284140265b3c', 'volume_name': 'volume-a4f562b3-2fe3-4f35-ba64-284140265b3c', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba8d891-efec-4093-bb8d-93d4a743042b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba8d891-efec-4093-bb8d-93d4a743042b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73b8529-781a-4efe-9722-44fc20776744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:08 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Volume a4f562b3-2fe3-4f35-ba64-284140265b3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f562b3-2fe3-4f35-ba64-284140265b3c', 'volume_size': 1} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139193211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f562b3-2fe3-4f35-ba64-284140265b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac96104bc4e447aa7632b53322844bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:09Z,use_quota=True,user_id='e383f36f3f414c02b5876deb1914732d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Creating volume a4f562b3-2fe3-4f35-ba64-284140265b3c {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:08 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4f562b3-2fe3-4f35-ba64-284140265b3c 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:08 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4f562b3-2fe3-4f35-ba64-284140265b3c 1073741824 Jul 03 14:08:08 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Acquiring lock "cinder-a800faf6-1789-45bf-a75b-c2c23020ebc0-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Lock "cinder-a800faf6-1789-45bf-a75b-c2c23020ebc0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Acquiring lock "cinder-quobyte-a800faf6-1789-45bf-a75b-c2c23020ebc0" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Lock "cinder-quobyte-a800faf6-1789-45bf-a75b-c2c23020ebc0" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6420da6a-3139-44c4-9031-e6713a3c85be]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a800faf6-1789-45bf-a75b-c2c23020ebc0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:09 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a800faf6-1789-45bf-a75b-c2c23020ebc0 Jul 03 14:08:09 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:09 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4f562b3-2fe3-4f35-ba64-284140265b3c 1073741824" returned: 0 in 0.827s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4f562b3-2fe3-4f35-ba64-284140265b3c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:09 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4f562b3-2fe3-4f35-ba64-284140265b3c Jul 03 14:08:09 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:09 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a800faf6-1789-45bf-a75b-c2c23020ebc0" returned: 0 in 0.785s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a800faf6-1789-45bf-a75b-c2c23020ebc0 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:09 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a800faf6-1789-45bf-a75b-c2c23020ebc0 Jul 03 14:08:09 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:10 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4f562b3-2fe3-4f35-ba64-284140265b3c" returned: 0 in 0.665s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73b8529-781a-4efe-9722-44fc20776744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f562b3-2fe3-4f35-ba64-284140265b3c', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e15d7d5-7fee-4d6a-864e-7548c069dd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:10 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a800faf6-1789-45bf-a75b-c2c23020ebc0" returned: 0 in 0.614s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:10 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Volume volume-a4f562b3-2fe3-4f35-ba64-284140265b3c (a4f562b3-2fe3-4f35-ba64-284140265b3c): created successfully Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e15d7d5-7fee-4d6a-864e-7548c069dd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Flow 'volume_create_manager' (f1c6df52-8e3b-4824-80c9-971054af6823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Lock "cinder-quobyte-a800faf6-1789-45bf-a75b-c2c23020ebc0" released by "delete_volume" :: held 1.449s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:10 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-be38a3bc-274c-4bd4-94a4-7aecac281cc3 tempest-ProjectReaderTests-181872585 None] Created volume successfully. Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Created reservations ['922a57d6-87a6-4b0e-a4d5-08235a5732b5', '2361437d-8cbf-43d3-9e56-084ba36a8220', 'b5973228-f8b5-417d-8f62-f9db618431d4', '4e7c5cf1-6fd7-4e79-a514-e188ebf03e8c'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:10 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:08:10 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Acquiring lock "cinder-a4f562b3-2fe3-4f35-ba64-284140265b3c-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Lock "cinder-a4f562b3-2fe3-4f35-ba64-284140265b3c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Acquiring lock "cinder-quobyte-a4f562b3-2fe3-4f35-ba64-284140265b3c" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Lock "cinder-quobyte-a4f562b3-2fe3-4f35-ba64-284140265b3c" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[706e7bcc-8cb4-4ed4-83d4-80b423643d27]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4f562b3-2fe3-4f35-ba64-284140265b3c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:11 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4f562b3-2fe3-4f35-ba64-284140265b3c Jul 03 14:08:11 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:11 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.674s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:11 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Deleted volume successfully. Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c00c3a2b-071b-4ea3-a409-d3d3d1775e6f tempest-ProjectReaderTests-2096725719 None] Lock "cinder-a800faf6-1789-45bf-a75b-c2c23020ebc0-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Flow 'volume_create_manager' (e45e9d90-0726-46a1-8f0b-1af150f77d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd64e73-c03f-43cf-91d2-d17f0a8fb51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd64e73-c03f-43cf-91d2-d17f0a8fb51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-276663040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbbb41a-fc09-4277-b9a5-c722be3c1390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7b4d2d2a694382a7f129c013734716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:11Z,use_quota=True,user_id='20b1b7ca103045ab84e4e007ee65572d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb203a6-ecd8-4487-9909-2972326d4e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb203a6-ecd8-4487-9909-2972326d4e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c9e00b-a4ea-41f7-9b11-8131e2d66b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c9e00b-a4ea-41f7-9b11-8131e2d66b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfbbb41a-fc09-4277-b9a5-c722be3c1390', 'volume_name': 'volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6ae456-759e-433f-b643-cfa2eda75a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6ae456-759e-433f-b643-cfa2eda75a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd1615b-c7cd-420c-9bbb-7bad898d7325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:11 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Volume dfbbb41a-fc09-4277-b9a5-c722be3c1390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390', 'volume_size': 1} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-276663040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbbb41a-fc09-4277-b9a5-c722be3c1390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7b4d2d2a694382a7f129c013734716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:11Z,use_quota=True,user_id='20b1b7ca103045ab84e4e007ee65572d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Creating volume dfbbb41a-fc09-4277-b9a5-c722be3c1390 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:11 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:11 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390 1073741824 Jul 03 14:08:11 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:11 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4f562b3-2fe3-4f35-ba64-284140265b3c" returned: 0 in 0.787s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4f562b3-2fe3-4f35-ba64-284140265b3c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:11 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4f562b3-2fe3-4f35-ba64-284140265b3c Jul 03 14:08:11 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:12 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4f562b3-2fe3-4f35-ba64-284140265b3c" returned: 0 in 0.648s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Lock "cinder-quobyte-a4f562b3-2fe3-4f35-ba64-284140265b3c" released by "delete_volume" :: held 1.481s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:12 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390 1073741824" returned: 0 in 0.846s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:12 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Created reservations ['8060c851-021e-4a7c-8e2f-a59df1bf6c1d', 'bae0f29d-5a4e-4a94-abe9-a66330cfc5d8', '32320188-d958-4072-a39b-b470653b942b', '03b69e1b-ee2d-4683-b880-4947c83e4ab9'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:12 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390 Jul 03 14:08:12 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:12 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:08:12 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:13 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390" returned: 0 in 0.666s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd1615b-c7cd-420c-9bbb-7bad898d7325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696e4bc9-ac7c-444e-b5ee-51c1ca3912e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:13 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Volume volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390 (dfbbb41a-fc09-4277-b9a5-c722be3c1390): created successfully Jul 03 14:08:13 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696e4bc9-ac7c-444e-b5ee-51c1ca3912e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Flow 'volume_create_manager' (e45e9d90-0726-46a1-8f0b-1af150f77d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.664s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Deleted volume successfully. Jul 03 14:08:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-358d454c-9024-4553-baa3-4967cc751caa tempest-ProjectReaderTests-2096725719 None] Created volume successfully. Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-00e4d1fa-6d81-40ef-b2cf-69dcb91c9e6f tempest-ProjectReaderTests-181872585 None] Lock "cinder-a4f562b3-2fe3-4f35-ba64-284140265b3c-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "cinder-dfbbb41a-fc09-4277-b9a5-c722be3c1390-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Lock "cinder-dfbbb41a-fc09-4277-b9a5-c722be3c1390-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "cinder-quobyte-dfbbb41a-fc09-4277-b9a5-c722be3c1390" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Lock "cinder-quobyte-dfbbb41a-fc09-4277-b9a5-c722be3c1390" acquired by "delete_volume" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06297cb-f981-453a-ae65-8bb3b2c62848]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:13 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390 Jul 03 14:08:13 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:14 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390" returned: 0 in 0.802s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:14 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390 Jul 03 14:08:14 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:15 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-dfbbb41a-fc09-4277-b9a5-c722be3c1390" returned: 0 in 0.654s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:15 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Lock "cinder-quobyte-dfbbb41a-fc09-4277-b9a5-c722be3c1390" released by "delete_volume" :: held 1.497s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:15 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Created reservations ['e20b3c6a-6bf3-44ec-86fb-d45235519450', 'daa01598-9df9-4bf6-a112-835e89ff944d', 'f792b48a-6baa-4768-932a-d1d6a0383fe9', 'e89178b8-825a-4af1-be6c-ad2b4ac66c53'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:15 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:08:15 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:15 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.622s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:15 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:15 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Deleted volume successfully. Jul 03 14:08:15 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d2b4ad92-4abf-446c-802e-7e288b9570e2 tempest-ProjectReaderTests-2096725719 None] Lock "cinder-dfbbb41a-fc09-4277-b9a5-c722be3c1390-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Flow 'volume_create_manager' (881315ee-e52b-48c0-95ea-bbef1c15dadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63909073-1828-4565-850a-d0bfadff13d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63909073-1828-4565-850a-d0bfadff13d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983249432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d0aa75-ad63-4ba3-892f-99e6eef111eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7b4d2d2a694382a7f129c013734716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:16Z,use_quota=True,user_id='20b1b7ca103045ab84e4e007ee65572d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7e7f66-2ecc-4f62-8f08-420fa13315c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7e7f66-2ecc-4f62-8f08-420fa13315c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817ddb88-7141-438b-8035-2b222147d25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817ddb88-7141-438b-8035-2b222147d25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d0aa75-ad63-4ba3-892f-99e6eef111eb', 'volume_name': 'volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e4aafa-e3bd-4afa-ab36-e4b45d318f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e4aafa-e3bd-4afa-ab36-e4b45d318f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c5912b-d98e-44fa-be43-a2b6084817fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:16 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Volume 47d0aa75-ad63-4ba3-892f-99e6eef111eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb', 'volume_size': 1} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983249432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d0aa75-ad63-4ba3-892f-99e6eef111eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7b4d2d2a694382a7f129c013734716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:16Z,use_quota=True,user_id='20b1b7ca103045ab84e4e007ee65572d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Creating volume 47d0aa75-ad63-4ba3-892f-99e6eef111eb {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:16 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:16 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb 1073741824 Jul 03 14:08:16 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:17 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb 1073741824" returned: 0 in 0.787s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:17 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb Jul 03 14:08:17 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:17 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb" returned: 0 in 0.680s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c5912b-d98e-44fa-be43-a2b6084817fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666eb857-66dd-41d0-b54b-ca558a901cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:17 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Volume volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb (47d0aa75-ad63-4ba3-892f-99e6eef111eb): created successfully Jul 03 14:08:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666eb857-66dd-41d0-b54b-ca558a901cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:17 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Flow 'volume_create_manager' (881315ee-e52b-48c0-95ea-bbef1c15dadb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e12b54e7-592c-403c-b6e5-5819976b6481 tempest-ProjectReaderTests-2096725719 None] Created volume successfully. Jul 03 14:08:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "cinder-47d0aa75-ad63-4ba3-892f-99e6eef111eb-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Lock "cinder-47d0aa75-ad63-4ba3-892f-99e6eef111eb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "cinder-quobyte-47d0aa75-ad63-4ba3-892f-99e6eef111eb" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Lock "cinder-quobyte-47d0aa75-ad63-4ba3-892f-99e6eef111eb" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:18 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fc3b0b-0e9f-42c1-bf7a-ba25c6f78e79]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:18 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb Jul 03 14:08:18 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:19 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb" returned: 0 in 0.762s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:19 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb Jul 03 14:08:19 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:19 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-47d0aa75-ad63-4ba3-892f-99e6eef111eb" returned: 0 in 0.657s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Lock "cinder-quobyte-47d0aa75-ad63-4ba3-892f-99e6eef111eb" released by "delete_volume" :: held 1.455s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:19 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Created reservations ['8740f4c3-7e0b-453e-8adf-8f934041ba7f', '80b8f835-3591-44a1-85c0-fa5d27092680', '3ca35a12-2a73-44b1-b5e2-84f03d7c46ed', '300e1184-03b1-49a0-9b5d-f6ae57cc3054'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:20 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:08:20 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:20 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.646s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:20 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:20 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Deleted volume successfully. Jul 03 14:08:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-08243610-bb7d-452c-90e5-d390a44d0cf2 tempest-ProjectReaderTests-2096725719 None] Lock "cinder-47d0aa75-ad63-4ba3-892f-99e6eef111eb-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:08:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:26 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:08:26 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:26 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.655s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:29 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=65,cinder:INSERT=27,cinder:UPDATE=107,cinder:DELETE=5 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:08:30 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=85,cinder:INSERT=26,cinder:UPDATE=109,cinder:DELETE=13 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:08:32 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Flow 'volume_create_manager' (724ee1dc-d562-4474-b79b-121b02fcae97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817fb5df-b819-4e51-889f-b21f8fbd467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:32 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Flow 'volume_create_manager' (56a37d21-db14-478a-90a7-b5f28e6683a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73b3c13-d94b-4149-89fd-03bb996fac26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817fb5df-b819-4e51-889f-b21f8fbd467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1465037487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485b723f-4e9a-4527-aab2-0139f299bff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fe7a84027d4b7584bcba8b20e68b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:33Z,use_quota=True,user_id='894635c2ab6a4b13a2fcab47213da444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d97be1-83db-4e2a-ba30-b9f28e82fe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d97be1-83db-4e2a-ba30-b9f28e82fe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4ab9bf-37e3-489e-b241-621f8bd412ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4ab9bf-37e3-489e-b241-621f8bd412ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '485b723f-4e9a-4527-aab2-0139f299bff5', 'volume_name': 'volume-485b723f-4e9a-4527-aab2-0139f299bff5', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51b1e85-163d-4c18-ab1d-5d6ad96e5006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b51b1e85-163d-4c18-ab1d-5d6ad96e5006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f006d186-b5f7-45fa-b274-ae64b5458d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:33 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Volume 485b723f-4e9a-4527-aab2-0139f299bff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-485b723f-4e9a-4527-aab2-0139f299bff5', 'volume_size': 1} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1465037487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485b723f-4e9a-4527-aab2-0139f299bff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fe7a84027d4b7584bcba8b20e68b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:33Z,use_quota=True,user_id='894635c2ab6a4b13a2fcab47213da444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Creating volume 485b723f-4e9a-4527-aab2-0139f299bff5 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:33 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-485b723f-4e9a-4527-aab2-0139f299bff5 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73b3c13-d94b-4149-89fd-03bb996fac26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1015915807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00071320-0479-4117-af52-87f69f32422b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f1be1fbd484709baff21ee687b10d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:33Z,use_quota=True,user_id='91ff7c2f6a634cb09e51ee7aa0c08dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079095b4-f3c4-4537-8b84-447907e3b12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079095b4-f3c4-4537-8b84-447907e3b12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6171ea-24e4-4b3b-8777-acbd33fea139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:33 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-485b723f-4e9a-4527-aab2-0139f299bff5 1073741824 Jul 03 14:08:33 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6171ea-24e4-4b3b-8777-acbd33fea139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00071320-0479-4117-af52-87f69f32422b', 'volume_name': 'volume-00071320-0479-4117-af52-87f69f32422b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aea508c-b2a8-4daf-9618-32f28808805d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aea508c-b2a8-4daf-9618-32f28808805d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c2bb17-bbf7-4934-a4b2-6e72894e0110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:33 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume 00071320-0479-4117-af52-87f69f32422b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00071320-0479-4117-af52-87f69f32422b', 'volume_size': 1} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Flow 'volume_create_manager' (cdb04834-fe6f-4c96-a6e9-b0d25bb1320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53eb0c1-4be2-4fde-973d-2e4a547b783f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53eb0c1-4be2-4fde-973d-2e4a547b783f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1001979684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf25f42-5eea-48ec-9eee-8857440806cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fe7a84027d4b7584bcba8b20e68b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:33Z,use_quota=True,user_id='894635c2ab6a4b13a2fcab47213da444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642a533f-25c6-49bc-a98e-c8849c8aff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (642a533f-25c6-49bc-a98e-c8849c8aff98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6321ada-13b1-428f-a7a3-d12e3a04518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6321ada-13b1-428f-a7a3-d12e3a04518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf25f42-5eea-48ec-9eee-8857440806cf', 'volume_name': 'volume-ccf25f42-5eea-48ec-9eee-8857440806cf', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f676f7a-edd6-4ccf-b485-917ea42acf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f676f7a-edd6-4ccf-b485-917ea42acf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7791b061-ced8-4c86-844f-7bac93ad498d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:33 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Volume ccf25f42-5eea-48ec-9eee-8857440806cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf25f42-5eea-48ec-9eee-8857440806cf', 'volume_size': 1} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:33 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Flow 'volume_create_manager' (3975a7dd-64ce-4084-a983-9fa1adb2ebd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd6733d-ec48-4fc7-8b70-fe868bacfb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd6733d-ec48-4fc7-8b70-fe868bacfb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1044687092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160e52a1-2870-466a-92ec-aac5ddb208b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72035ddc72442719e6c8232c1d3e235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:34Z,use_quota=True,user_id='593deefe6a914fae8482d32eaad89de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5c31d3-a4db-4c50-b948-78a5a84f830a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5c31d3-a4db-4c50-b948-78a5a84f830a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb59a0d3-4724-459a-a574-66deb81033a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb59a0d3-4724-459a-a574-66deb81033a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '160e52a1-2870-466a-92ec-aac5ddb208b3', 'volume_name': 'volume-160e52a1-2870-466a-92ec-aac5ddb208b3', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e33a7ca-c22f-419f-a298-e58d0b0968a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e33a7ca-c22f-419f-a298-e58d0b0968a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13aa36d9-d728-4aba-b97e-601078606822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume 160e52a1-2870-466a-92ec-aac5ddb208b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-160e52a1-2870-466a-92ec-aac5ddb208b3', 'volume_size': 1} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Flow 'volume_create_manager' (588de519-3dff-4efb-bd66-2d5ea27e4e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d0a9fb-56e3-40a5-8981-52a07c80c69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d0a9fb-56e3-40a5-8981-52a07c80c69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2006683383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a39c1b-cf08-4312-bcf2-8cc797bc0724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fe7a84027d4b7584bcba8b20e68b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:34Z,use_quota=True,user_id='894635c2ab6a4b13a2fcab47213da444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e0cdee-db08-450c-8977-b94f5fbf4f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e0cdee-db08-450c-8977-b94f5fbf4f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3d680c-ca14-4a9d-acfe-028b6f993b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3d680c-ca14-4a9d-acfe-028b6f993b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97a39c1b-cf08-4312-bcf2-8cc797bc0724', 'volume_name': 'volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8bd960-0347-428b-bcea-e6e2fc074166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8bd960-0347-428b-bcea-e6e2fc074166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5251b79-73a1-4dee-9cbb-48315a48ed6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Volume 97a39c1b-cf08-4312-bcf2-8cc797bc0724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724', 'volume_size': 1} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:34 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Flow 'volume_create_manager' (62f4da06-3bfb-4319-a1f6-04f500073c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb70e49-7981-44c3-a797-ae3d0304fda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-485b723f-4e9a-4527-aab2-0139f299bff5 1073741824" returned: 0 in 1.370s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb70e49-7981-44c3-a797-ae3d0304fda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-847154969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b819c58-95c9-4655-a252-5a8539a61ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fe7a84027d4b7584bcba8b20e68b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:34Z,use_quota=True,user_id='894635c2ab6a4b13a2fcab47213da444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552a265e-832d-40c8-8fd3-839bf4e64738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552a265e-832d-40c8-8fd3-839bf4e64738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c141d036-938b-4bea-8008-dc0964fbe15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c141d036-938b-4bea-8008-dc0964fbe15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b819c58-95c9-4655-a252-5a8539a61ebb', 'volume_name': 'volume-8b819c58-95c9-4655-a252-5a8539a61ebb', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0306cd9c-cdc7-45f0-8cb5-71511f629ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0306cd9c-cdc7-45f0-8cb5-71511f629ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e25a2a-1217-41b3-8d30-35c3486219fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Volume 8b819c58-95c9-4655-a252-5a8539a61ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b819c58-95c9-4655-a252-5a8539a61ebb', 'volume_size': 1} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-485b723f-4e9a-4527-aab2-0139f299bff5 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:34 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-485b723f-4e9a-4527-aab2-0139f299bff5 Jul 03 14:08:34 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Flow 'volume_create_manager' (64fd4c34-6b25-47f3-a93b-cb5056a7f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd207e2-1e9b-4433-84b0-137f97adb47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd207e2-1e9b-4433-84b0-137f97adb47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2049180765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6ca996-3e55-489a-90f8-972a056ece15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fe7a84027d4b7584bcba8b20e68b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:34Z,use_quota=True,user_id='894635c2ab6a4b13a2fcab47213da444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eea881c-99f8-4fb2-af57-4d454b12ae61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eea881c-99f8-4fb2-af57-4d454b12ae61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f229e3-68f6-4490-8c59-7182c2a1b8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f229e3-68f6-4490-8c59-7182c2a1b8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f6ca996-3e55-489a-90f8-972a056ece15', 'volume_name': 'volume-9f6ca996-3e55-489a-90f8-972a056ece15', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085d8e25-1d30-4f34-8ddf-cf271acc82ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085d8e25-1d30-4f34-8ddf-cf271acc82ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f226c60-62e7-44db-945c-8f40f013a76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:34 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Volume 9f6ca996-3e55-489a-90f8-972a056ece15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f6ca996-3e55-489a-90f8-972a056ece15', 'volume_size': 1} Jul 03 14:08:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:35 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-485b723f-4e9a-4527-aab2-0139f299bff5" returned: 0 in 0.658s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.034s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1015915807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00071320-0479-4117-af52-87f69f32422b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f1be1fbd484709baff21ee687b10d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:33Z,use_quota=True,user_id='91ff7c2f6a634cb09e51ee7aa0c08dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Creating volume 00071320-0479-4117-af52-87f69f32422b {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:35 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:35 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b 1073741824 Jul 03 14:08:35 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f006d186-b5f7-45fa-b274-ae64b5458d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-485b723f-4e9a-4527-aab2-0139f299bff5', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e62daa-7164-4afe-8ce9-a630502273e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:35 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Volume volume-485b723f-4e9a-4527-aab2-0139f299bff5 (485b723f-4e9a-4527-aab2-0139f299bff5): created successfully Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e62daa-7164-4afe-8ce9-a630502273e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:35 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Flow 'volume_create_manager' (724ee1dc-d562-4474-b79b-121b02fcae97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:35 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-0e579fa7-f1ba-4ee2-aa40-bdd25d45d148 tempest-CreateVolumesFromImageTest-1961996991 None] Created volume successfully. Jul 03 14:08:36 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b 1073741824" returned: 0 in 0.984s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:36 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b Jul 03 14:08:36 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Flow 'volume_create_manager' (70d116a9-85c6-41ec-99d5-cc1be2dd320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2995a0f0-7d06-40a3-a6a4-5764a974b9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2995a0f0-7d06-40a3-a6a4-5764a974b9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e899587a-311b-49e6-9e91-1f23670bfb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='321a6d6da0e9414c8be04b72bd6c774c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:37Z,use_quota=True,user_id='a39e84ee47df41568f32cf42cf8ccddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e601b098-10de-48bd-9a95-fae2a7ec2fc6),volume_type_id=e601b098-10de-48bd-9a95-fae2a7ec2fc6)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b8cae9-1e78-452b-8bff-e066e7fa33ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b8cae9-1e78-452b-8bff-e066e7fa33ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a83245f-b7c5-42bb-9736-04524328e1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.image.glance [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Creating Keystone auth plugin from conf {{(pid=86729) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:08:36 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b" returned: 0 in 0.709s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.540s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1001979684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf25f42-5eea-48ec-9eee-8857440806cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fe7a84027d4b7584bcba8b20e68b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:33Z,use_quota=True,user_id='894635c2ab6a4b13a2fcab47213da444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Creating volume ccf25f42-5eea-48ec-9eee-8857440806cf {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:36 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ccf25f42-5eea-48ec-9eee-8857440806cf 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:36 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ccf25f42-5eea-48ec-9eee-8857440806cf 1073741824 Jul 03 14:08:36 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c2bb17-bbf7-4934-a4b2-6e72894e0110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00071320-0479-4117-af52-87f69f32422b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe44e535-7563-4fa8-b1a8-f7f5cf736809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:36 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume volume-00071320-0479-4117-af52-87f69f32422b (00071320-0479-4117-af52-87f69f32422b): created successfully Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe44e535-7563-4fa8-b1a8-f7f5cf736809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Flow 'volume_create_manager' (56a37d21-db14-478a-90a7-b5f28e6683a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:36 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d3d16791-7053-4ab4-add2-f6e5dd2ed398 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created volume successfully. Jul 03 14:08:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a83245f-b7c5-42bb-9736-04524328e1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e899587a-311b-49e6-9e91-1f23670bfb02', 'volume_name': 'volume-e899587a-311b-49e6-9e91-1f23670bfb02', 'volume_size': 1, 'image_id': '768381fb-1532-4d59-b031-afac70d3c781', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/768381fb-1532-4d59-b031-afac70d3c781', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21c1eea69c557b7eb7ed9a715b5816f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '321a6d6da0e9414c8be04b72bd6c774c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98f2decd3bd12c9b139ba5c45862f9b1b138aa99162c9a1133db3579fc1e11b7bbeed565dff896c688c423cc55dfcc1e0b65c3d721cc7fad2ae6219586b11be6', 'id': '768381fb-1532-4d59-b031-afac70d3c781', 'created_at': datetime.datetime(2026, 7, 3, 12, 8, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 8, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/768381fb-1532-4d59-b031-afac70d3c781/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de438a4c-348c-41dd-816a-13547e8a8828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de438a4c-348c-41dd-816a-13547e8a8828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451f14ea-b632-48c2-8c44-f9777a6da34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:37 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Volume e899587a-311b-49e6-9e91-1f23670bfb02: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e899587a-311b-49e6-9e91-1f23670bfb02', 'volume_size': 1, 'image_id': '768381fb-1532-4d59-b031-afac70d3c781', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/768381fb-1532-4d59-b031-afac70d3c781', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21c1eea69c557b7eb7ed9a715b5816f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '321a6d6da0e9414c8be04b72bd6c774c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98f2decd3bd12c9b139ba5c45862f9b1b138aa99162c9a1133db3579fc1e11b7bbeed565dff896c688c423cc55dfcc1e0b65c3d721cc7fad2ae6219586b11be6', 'id': '768381fb-1532-4d59-b031-afac70d3c781', 'created_at': datetime.datetime(2026, 7, 3, 12, 8, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 8, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/768381fb-1532-4d59-b031-afac70d3c781/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 14:08:37 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Trying to clone e899587a-311b-49e6-9e91-1f23670bfb02 from image 768381fb-1532-4d59-b031-afac70d3c781 at location (None, [{'url': 'file:///opt/stack/data/glance/images/768381fb-1532-4d59-b031-afac70d3c781', 'metadata': {}}]). {{(pid=86729) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:08:37 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:08:37 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Image download 0.00 MB at 0.00 MB/s Jul 03 14:08:37 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9010de3-ac72-4693-bb22-de94ff429b84]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:37 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD Jul 03 14:08:37 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:37 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ccf25f42-5eea-48ec-9eee-8857440806cf 1073741824" returned: 0 in 0.917s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ccf25f42-5eea-48ec-9eee-8857440806cf {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:37 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ccf25f42-5eea-48ec-9eee-8857440806cf Jul 03 14:08:37 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:38 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:38 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD Jul 03 14:08:38 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:38 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ccf25f42-5eea-48ec-9eee-8857440806cf" returned: 0 in 0.810s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.543s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1044687092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160e52a1-2870-466a-92ec-aac5ddb208b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72035ddc72442719e6c8232c1d3e235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:34Z,use_quota=True,user_id='593deefe6a914fae8482d32eaad89de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Creating volume 160e52a1-2870-466a-92ec-aac5ddb208b3 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:38 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-160e52a1-2870-466a-92ec-aac5ddb208b3 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:38 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-160e52a1-2870-466a-92ec-aac5ddb208b3 1073741824 Jul 03 14:08:38 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7791b061-ced8-4c86-844f-7bac93ad498d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf25f42-5eea-48ec-9eee-8857440806cf', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a56267-ade5-4db2-9a32-b2b93e13ffff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:38 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:38 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Volume volume-ccf25f42-5eea-48ec-9eee-8857440806cf (ccf25f42-5eea-48ec-9eee-8857440806cf): created successfully Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a56267-ade5-4db2-9a32-b2b93e13ffff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Flow 'volume_create_manager' (cdb04834-fe6f-4c96-a6e9-b0d25bb1320b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD" returned: 1 in 0.751s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Temporary image 768381fb-1532-4d59-b031-afac70d3c781 is fetched for user a39e84ee47df41568f32cf42cf8ccddd. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:08:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-79623f09-7548-48ea-bdf3-001b3d38bb5e tempest-CreateVolumesFromImageTest-1961996991 None] Created volume successfully. Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[acadc36b-98f3-45cc-a640-3e9bd660b796]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:38 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD Jul 03 14:08:38 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:39 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-160e52a1-2870-466a-92ec-aac5ddb208b3 1073741824" returned: 0 in 0.910s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:39 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-160e52a1-2870-466a-92ec-aac5ddb208b3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:39 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-160e52a1-2870-466a-92ec-aac5ddb208b3 Jul 03 14:08:39 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:39 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD Jul 03 14:08:39 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:40 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD" returned: 1 in 0.736s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:40 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-160e52a1-2870-466a-92ec-aac5ddb208b3" returned: 0 in 0.734s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.074s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2006683383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a39c1b-cf08-4312-bcf2-8cc797bc0724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fe7a84027d4b7584bcba8b20e68b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:34Z,use_quota=True,user_id='894635c2ab6a4b13a2fcab47213da444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Creating volume 97a39c1b-cf08-4312-bcf2-8cc797bc0724 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:40 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13aa36d9-d728-4aba-b97e-601078606822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-160e52a1-2870-466a-92ec-aac5ddb208b3', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33a2dd6-6e83-49e5-b445-0f45e6359b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:40 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724 1073741824 Jul 03 14:08:40 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:40 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume volume-160e52a1-2870-466a-92ec-aac5ddb208b3 (160e52a1-2870-466a-92ec-aac5ddb208b3): created successfully Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33a2dd6-6e83-49e5-b445-0f45e6359b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Flow 'volume_create_manager' (3975a7dd-64ce-4084-a983-9fa1adb2ebd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:40 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-8663b34f-ca74-4451-97e7-dd027e3e4e42 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Created volume successfully. Jul 03 14:08:41 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724 1073741824" returned: 0 in 0.806s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:41 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724 Jul 03 14:08:41 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Flow 'volume_create_manager' (0c55e636-f3e2-4973-a9c1-c38efdb70a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11e3465-70b5-46b0-9950-75dc8fa3524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11e3465-70b5-46b0-9950-75dc8fa3524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1256854066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d5ff94-1f39-47e6-b80d-c3fccc79dd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72035ddc72442719e6c8232c1d3e235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:41Z,use_quota=True,user_id='593deefe6a914fae8482d32eaad89de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf83c5e-7e61-4731-915a-b035ab163887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf83c5e-7e61-4731-915a-b035ab163887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa7b96c-110f-48fb-87f8-718400b95f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa7b96c-110f-48fb-87f8-718400b95f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d5ff94-1f39-47e6-b80d-c3fccc79dd10', 'volume_name': 'volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548b8eaa-9e7c-4239-9fa5-30131ebda9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548b8eaa-9e7c-4239-9fa5-30131ebda9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd34eb3-5bb3-4b95-9df5-a73b7d0f540d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:41 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume 91d5ff94-1f39-47e6-b80d-c3fccc79dd10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10', 'volume_size': 1} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Flow 'volume_create_manager' (920685f8-42b4-4624-9c89-a3d862afcea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3577839-9d00-43d4-a43a-97de35c35ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3577839-9d00-43d4-a43a-97de35c35ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-132572986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858d35da-5abd-47a8-aee3-144b3a7ff85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72035ddc72442719e6c8232c1d3e235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:42Z,use_quota=True,user_id='593deefe6a914fae8482d32eaad89de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568c6c5f-a260-4cf6-9fc7-3c8e2e99158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568c6c5f-a260-4cf6-9fc7-3c8e2e99158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a81d9d-8af4-470e-bc02-356ea09fddec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a81d9d-8af4-470e-bc02-356ea09fddec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '858d35da-5abd-47a8-aee3-144b3a7ff85e', 'volume_name': 'volume-858d35da-5abd-47a8-aee3-144b3a7ff85e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f26064c-5929-4f40-97c0-7a9caf4dad1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f26064c-5929-4f40-97c0-7a9caf4dad1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4407af6f-4fca-4d41-8616-e6e5bc721705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:41 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume 858d35da-5abd-47a8-aee3-144b3a7ff85e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-858d35da-5abd-47a8-aee3-144b3a7ff85e', 'volume_size': 1} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:41 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724" returned: 0 in 0.719s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.515s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-847154969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b819c58-95c9-4655-a252-5a8539a61ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fe7a84027d4b7584bcba8b20e68b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:34Z,use_quota=True,user_id='894635c2ab6a4b13a2fcab47213da444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Creating volume 8b819c58-95c9-4655-a252-5a8539a61ebb {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:41 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8b819c58-95c9-4655-a252-5a8539a61ebb 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:42 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8b819c58-95c9-4655-a252-5a8539a61ebb 1073741824 Jul 03 14:08:42 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5251b79-73a1-4dee-9cbb-48315a48ed6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19afe4fe-34fa-4720-9a03-065ee6d56394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Volume volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724 (97a39c1b-cf08-4312-bcf2-8cc797bc0724): created successfully Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19afe4fe-34fa-4720-9a03-065ee6d56394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Flow 'volume_create_manager' (588de519-3dff-4efb-bd66-2d5ea27e4e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:42 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ec82f4f6-ca69-4f97-a9ce-282f80d0cdda tempest-CreateVolumesFromImageTest-1961996991 None] Created volume successfully. Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Flow 'volume_create_manager' (c6ca2b41-5882-4f7e-b65b-8221499a535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f52fc1-d5ad-4d5b-89ab-d9338ff1924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f52fc1-d5ad-4d5b-89ab-d9338ff1924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-223244838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5fb3f3-d83d-450c-a691-24d842a6bb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72035ddc72442719e6c8232c1d3e235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:42Z,use_quota=True,user_id='593deefe6a914fae8482d32eaad89de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45f78c9-f499-4511-84d6-8a73382220b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45f78c9-f499-4511-84d6-8a73382220b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29145a32-b254-4633-ac77-9b5933734079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29145a32-b254-4633-ac77-9b5933734079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5fb3f3-d83d-450c-a691-24d842a6bb33', 'volume_name': 'volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4e5107-1364-496f-96cb-60d8b0de7c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4e5107-1364-496f-96cb-60d8b0de7c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bfedb7-06ea-4054-81a9-dd01d125a967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume 6f5fb3f3-d83d-450c-a691-24d842a6bb33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33', 'volume_size': 1} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Flow 'volume_create_manager' (f98c86ae-1170-4126-a551-2d069abdf977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34963400-a81c-45ef-81ad-bc1556f84bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34963400-a81c-45ef-81ad-bc1556f84bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1376188150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d396100e-7161-4879-854d-6fe86e20d9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72035ddc72442719e6c8232c1d3e235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:43Z,use_quota=True,user_id='593deefe6a914fae8482d32eaad89de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d786c5-433a-4260-9e3e-5f5a2dd1c985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d786c5-433a-4260-9e3e-5f5a2dd1c985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a8827d-b392-4fe1-a093-eea05eedab0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a8827d-b392-4fe1-a093-eea05eedab0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd396100e-7161-4879-854d-6fe86e20d9aa', 'volume_name': 'volume-d396100e-7161-4879-854d-6fe86e20d9aa', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0521fcc-f54b-4c4e-9455-fb2c7a4d221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0521fcc-f54b-4c4e-9455-fb2c7a4d221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf24fc8-361e-4e6d-916c-c769cd79d6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume d396100e-7161-4879-854d-6fe86e20d9aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d396100e-7161-4879-854d-6fe86e20d9aa', 'volume_size': 1} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:42 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Flow 'volume_create_manager' (d7dce78c-9e3d-4886-b898-3df2640fe3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637923b3-959f-4603-9574-ad41ef624350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8b819c58-95c9-4655-a252-5a8539a61ebb 1073741824" returned: 0 in 0.984s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637923b3-959f-4603-9574-ad41ef624350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1811037942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a096b34d-9a0e-4aa7-b4aa-010017b7e818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72035ddc72442719e6c8232c1d3e235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:43Z,use_quota=True,user_id='593deefe6a914fae8482d32eaad89de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d96cd61-9f85-4f9d-ba5d-42f17e65d951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d96cd61-9f85-4f9d-ba5d-42f17e65d951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893a8384-eb10-460e-8644-db269a82350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893a8384-eb10-460e-8644-db269a82350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a096b34d-9a0e-4aa7-b4aa-010017b7e818', 'volume_name': 'volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ed48dd-0613-43f8-85c8-9fb4e5473677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ed48dd-0613-43f8-85c8-9fb4e5473677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e46b8e21-385e-452d-927f-d17eb617c64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:43 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume a096b34d-9a0e-4aa7-b4aa-010017b7e818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818', 'volume_size': 1} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8b819c58-95c9-4655-a252-5a8539a61ebb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:43 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8b819c58-95c9-4655-a252-5a8539a61ebb Jul 03 14:08:43 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:43 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8b819c58-95c9-4655-a252-5a8539a61ebb" returned: 0 in 0.679s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.113s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2049180765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6ca996-3e55-489a-90f8-972a056ece15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fe7a84027d4b7584bcba8b20e68b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:34Z,use_quota=True,user_id='894635c2ab6a4b13a2fcab47213da444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Creating volume 9f6ca996-3e55-489a-90f8-972a056ece15 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:43 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9f6ca996-3e55-489a-90f8-972a056ece15 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e25a2a-1217-41b3-8d30-35c3486219fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b819c58-95c9-4655-a252-5a8539a61ebb', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:43 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9f6ca996-3e55-489a-90f8-972a056ece15 1073741824 Jul 03 14:08:43 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1366082d-4e5a-466a-bd9d-54d72f1d9660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:43 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Volume volume-8b819c58-95c9-4655-a252-5a8539a61ebb (8b819c58-95c9-4655-a252-5a8539a61ebb): created successfully Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1366082d-4e5a-466a-bd9d-54d72f1d9660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:43 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Flow 'volume_create_manager' (62f4da06-3bfb-4319-a1f6-04f500073c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:43 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c3c15c01-53ea-4789-b4ca-b0b73b120508 tempest-CreateVolumesFromImageTest-1961996991 None] Created volume successfully. Jul 03 14:08:44 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9f6ca996-3e55-489a-90f8-972a056ece15 1073741824" returned: 0 in 0.810s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9f6ca996-3e55-489a-90f8-972a056ece15 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:44 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9f6ca996-3e55-489a-90f8-972a056ece15 Jul 03 14:08:44 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:45 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9f6ca996-3e55-489a-90f8-972a056ece15" returned: 0 in 0.610s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.796s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f226c60-62e7-44db-945c-8f40f013a76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6ca996-3e55-489a-90f8-972a056ece15', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8620cf68-7f6e-431f-a370-06d13fe75ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] Creating offline snapshot 47326e69-33a5-4d54-b796-ab7d50056493 of volume 00071320-0479-4117-af52-87f69f32422b {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:08:45 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Volume volume-9f6ca996-3e55-489a-90f8-972a056ece15 (9f6ca996-3e55-489a-90f8-972a056ece15): created successfully Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8620cf68-7f6e-431f-a370-06d13fe75ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Flow 'volume_create_manager' (64fd4c34-6b25-47f3-a93b-cb5056a7f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6761d19b-e507-4fe0-b4f0-e17d03be9108]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:45 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-91cc851b-ae4f-43ec-af9c-c3b33cf35e25 tempest-CreateVolumesFromImageTest-1961996991 None] Created volume successfully. Jul 03 14:08:45 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b Jul 03 14:08:45 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "cinder-9f6ca996-3e55-489a-90f8-972a056ece15-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-9f6ca996-3e55-489a-90f8-972a056ece15-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "cinder-quobyte-9f6ca996-3e55-489a-90f8-972a056ece15" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-quobyte-9f6ca996-3e55-489a-90f8-972a056ece15" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[52908f67-4d16-41ec-90db-583d65bbe15f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9f6ca996-3e55-489a-90f8-972a056ece15 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:45 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9f6ca996-3e55-489a-90f8-972a056ece15 Jul 03 14:08:45 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:46 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b" returned: 0 in 0.793s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:46 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 1G Jul 03 14:08:46 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:46 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9f6ca996-3e55-489a-90f8-972a056ece15" returned: 0 in 0.742s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9f6ca996-3e55-489a-90f8-972a056ece15 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:46 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9f6ca996-3e55-489a-90f8-972a056ece15 Jul 03 14:08:46 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:46 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 1G" returned: 0 in 0.806s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00071320-0479-4117-af52-87f69f32422b -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:46 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00071320-0479-4117-af52-87f69f32422b -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 Jul 03 14:08:46 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:46 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-9f6ca996-3e55-489a-90f8-972a056ece15" returned: 0 in 0.673s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-quobyte-9f6ca996-3e55-489a-90f8-972a056ece15" released by "delete_volume" :: held 1.458s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Created reservations ['8aa6a512-8bf0-4218-a0ef-b8357a90fd27', 'f522de81-8d15-49ef-bbb2-721ee0c19c83', 'b4ae4741-5cd4-43c0-8133-56be0fa9cfed', '8e414b01-1b56-4b99-a021-76ba433b821c'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:47 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:08:47 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:47 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00071320-0479-4117-af52-87f69f32422b -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493" returned: 0 in 0.716s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:47 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 is being set with open permissions: ugo+rw Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:47 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 Jul 03 14:08:47 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "cinder-8b819c58-95c9-4655-a252-5a8539a61ebb-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-8b819c58-95c9-4655-a252-5a8539a61ebb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "cinder-quobyte-8b819c58-95c9-4655-a252-5a8539a61ebb" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-quobyte-8b819c58-95c9-4655-a252-5a8539a61ebb" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b8d2fa-b496-4a81-a5f8-344f99f3ba8e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8b819c58-95c9-4655-a252-5a8539a61ebb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:47 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.717s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:47 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Deleted volume successfully. Jul 03 14:08:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b170b014-e8cd-4c0f-b880-93cf0df5fecb tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-9f6ca996-3e55-489a-90f8-972a056ece15-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:47 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8b819c58-95c9-4655-a252-5a8539a61ebb Jul 03 14:08:47 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:48 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493" returned: 0 in 0.687s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:48 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.info Jul 03 14:08:48 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:48 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8b819c58-95c9-4655-a252-5a8539a61ebb" returned: 0 in 0.780s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8b819c58-95c9-4655-a252-5a8539a61ebb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:48 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8b819c58-95c9-4655-a252-5a8539a61ebb Jul 03 14:08:48 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:48 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.info" returned: 0 in 0.673s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:48 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.info is being set with open permissions: ugo+rw Jul 03 14:08:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:48 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.info Jul 03 14:08:48 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:49 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8b819c58-95c9-4655-a252-5a8539a61ebb" returned: 0 in 0.649s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-quobyte-8b819c58-95c9-4655-a252-5a8539a61ebb" released by "delete_volume" :: held 1.466s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Created reservations ['a49472b8-47bb-4ab6-8cc5-7a3ab5a564c4', 'f764a199-9220-4876-900c-addeb7963f2c', '3e4d3609-b0c8-45f5-8ef9-254e9d8163c3', '03b012c9-87bb-4c9f-b9d7-00fcaefa4fbb'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:49 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:08:49 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:49 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.info" returned: 0 in 0.679s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.475s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.305s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e899587a-311b-49e6-9e91-1f23670bfb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='321a6d6da0e9414c8be04b72bd6c774c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:37Z,use_quota=True,user_id='a39e84ee47df41568f32cf42cf8ccddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e601b098-10de-48bd-9a95-fae2a7ec2fc6),volume_type_id=e601b098-10de-48bd-9a95-fae2a7ec2fc6)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Creating volume e899587a-311b-49e6-9e91-1f23670bfb02 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:49 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:49 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 1073741824 Jul 03 14:08:49 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:49 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-14dbf89a-5317-4c57-8b75-6fa8fe3921bc tempest-CreateVolumesFromSnapshotTest-1708496540 None] Create snapshot completed successfully Jul 03 14:08:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "cinder-97a39c1b-cf08-4312-bcf2-8cc797bc0724-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-97a39c1b-cf08-4312-bcf2-8cc797bc0724-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:50 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "cinder-quobyte-97a39c1b-cf08-4312-bcf2-8cc797bc0724" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.742s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Deleted volume successfully. Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-quobyte-97a39c1b-cf08-4312-bcf2-8cc797bc0724" acquired by "delete_volume" :: waited 0.037s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-609854ab-6ff5-4318-af57-29c94a3d4f8f tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-8b819c58-95c9-4655-a252-5a8539a61ebb-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dfc598-42c0-4501-86c0-2990b9f403f6]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:50 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724 Jul 03 14:08:50 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Flow 'volume_create_manager' (426bd1d9-3733-4ee5-aa9e-f0d45f0503f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb2684b-cda8-4425-997a-0614c3902cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb2684b-cda8-4425-997a-0614c3902cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-651386703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07892a68-781c-48e1-ba96-0520f0f22ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f1be1fbd484709baff21ee687b10d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:50Z,use_quota=True,user_id='91ff7c2f6a634cb09e51ee7aa0c08dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2fb5f4-ed44-46c2-8d1a-224bede39e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2fb5f4-ed44-46c2-8d1a-224bede39e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293308ef-0e79-44f5-8cef-1de22794518c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293308ef-0e79-44f5-8cef-1de22794518c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07892a68-781c-48e1-ba96-0520f0f22ec3', 'volume_name': 'volume-07892a68-781c-48e1-ba96-0520f0f22ec3', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f49aada-01b4-4f2e-84ae-133bf9e616a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f49aada-01b4-4f2e-84ae-133bf9e616a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171d4115-9167-46a8-8050-bd19c5fee915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:50 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume 07892a68-781c-48e1-ba96-0520f0f22ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07892a68-781c-48e1-ba96-0520f0f22ec3', 'volume_size': 1} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:50 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 1073741824" returned: 0 in 1.122s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:50 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 Jul 03 14:08:50 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Flow 'volume_create_manager' (051923d4-c954-4d2f-ae21-3717d0db72a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e3ca9d-3ef5-434f-9256-62cab3af5a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e3ca9d-3ef5-434f-9256-62cab3af5a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-483371993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4b857a-14d4-4b78-8505-fd865bfb48a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f1be1fbd484709baff21ee687b10d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:51Z,use_quota=True,user_id='91ff7c2f6a634cb09e51ee7aa0c08dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b372807-6194-492d-8d5f-7160adc55728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b372807-6194-492d-8d5f-7160adc55728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb577007-bf43-4f43-9106-5c5283e9c93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb577007-bf43-4f43-9106-5c5283e9c93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d4b857a-14d4-4b78-8505-fd865bfb48a1', 'volume_name': 'volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec79dcb-10df-4b66-9643-db9f1981c31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec79dcb-10df-4b66-9643-db9f1981c31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4c83be-2cd7-4173-9a1c-853c6559ab52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:50 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume 6d4b857a-14d4-4b78-8505-fd865bfb48a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1', 'volume_size': 1} Jul 03 14:08:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:51 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724" returned: 0 in 0.983s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:51 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724 Jul 03 14:08:51 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Flow 'volume_create_manager' (19d772a5-980a-4741-a7a3-1f9e2639c81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90f5bc7-afd6-4dfb-9cd5-336f61a8a467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90f5bc7-afd6-4dfb-9cd5-336f61a8a467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-261489251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94031ad3-a73c-4a36-9612-04e51a2ce224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f1be1fbd484709baff21ee687b10d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:51Z,use_quota=True,user_id='91ff7c2f6a634cb09e51ee7aa0c08dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdef1249-79c8-4c39-bfd5-f5e576a01214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdef1249-79c8-4c39-bfd5-f5e576a01214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fda12b-37dd-4e9a-910d-66f6a140fe87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fda12b-37dd-4e9a-910d-66f6a140fe87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94031ad3-a73c-4a36-9612-04e51a2ce224', 'volume_name': 'volume-94031ad3-a73c-4a36-9612-04e51a2ce224', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223f410d-f935-495a-a80f-ae9bdaacdd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223f410d-f935-495a-a80f-ae9bdaacdd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3f5921-2a17-4e33-8eec-fd35dd89a460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:51 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume 94031ad3-a73c-4a36-9612-04e51a2ce224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94031ad3-a73c-4a36-9612-04e51a2ce224', 'volume_size': 1} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:51 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02" returned: 0 in 0.817s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.078s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1256854066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d5ff94-1f39-47e6-b80d-c3fccc79dd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72035ddc72442719e6c8232c1d3e235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:41Z,use_quota=True,user_id='593deefe6a914fae8482d32eaad89de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Creating volume 91d5ff94-1f39-47e6-b80d-c3fccc79dd10 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:51 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:51 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10 1073741824 Jul 03 14:08:51 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Attempting download of 768381fb-1532-4d59-b031-afac70d3c781 ((None, [{'url': 'file:///opt/stack/data/glance/images/768381fb-1532-4d59-b031-afac70d3c781', 'metadata': {}}])) to volume e899587a-311b-49e6-9e91-1f23670bfb02. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Flow 'volume_create_manager' (525aec41-e1b4-458c-a572-378b59b13357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f24c267-75a7-4f0c-be95-f060d257234a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f24c267-75a7-4f0c-be95-f060d257234a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-746719149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f1be1fbd484709baff21ee687b10d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:52Z,use_quota=True,user_id='91ff7c2f6a634cb09e51ee7aa0c08dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4254b2-705e-4042-9740-40e6f1d2eb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4254b2-705e-4042-9740-40e6f1d2eb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36672e4-3bcb-44b3-b19b-8a4d775c23b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36672e4-3bcb-44b3-b19b-8a4d775c23b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb', 'volume_name': 'volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ceae895-5ad1-4b3c-b769-63f44861ffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ceae895-5ad1-4b3c-b769-63f44861ffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560e6954-c8a8-4400-aa56-489a33966d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:51 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb', 'volume_size': 1} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b487fabc-8152-4f7e-b2eb-bd9b6e7c61a1]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_768381fb-1532-4d59-b031-afac70d3c781_cddvt0ls {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:52 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_768381fb-1532-4d59-b031-afac70d3c781_cddvt0ls Jul 03 14:08:52 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:52 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-97a39c1b-cf08-4312-bcf2-8cc797bc0724" returned: 0 in 0.966s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-quobyte-97a39c1b-cf08-4312-bcf2-8cc797bc0724" released by "delete_volume" :: held 2.013s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Flow 'volume_create_manager' (96d9ee35-425f-4509-b70a-164a8a7128e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15299432-c361-48ae-a53e-b66c718917da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15299432-c361-48ae-a53e-b66c718917da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922911235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f1be1fbd484709baff21ee687b10d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:52Z,use_quota=True,user_id='91ff7c2f6a634cb09e51ee7aa0c08dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3ccf8a-418a-4bf6-8b2c-d214f4f2da90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3ccf8a-418a-4bf6-8b2c-d214f4f2da90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5528e712-7690-421f-a17d-f93777079f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5528e712-7690-421f-a17d-f93777079f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc', 'volume_name': 'volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4647bada-181d-4794-b403-9c80f31ca4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4647bada-181d-4794-b403-9c80f31ca4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c91d4f-943c-44ec-8428-23b92f7ec370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:52 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume 3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc', 'volume_size': 1} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Created reservations ['ef3d7a88-87b8-4ccd-b20d-85851f7d97f1', '53946b7f-f017-430d-910f-eb14ad1e610e', '1a6a387a-2bfb-4101-bda7-516ee5b5ba36', 'a8d85c72-574d-40ac-964a-e78acd971361'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:52 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:08:52 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:52 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10 1073741824" returned: 0 in 0.961s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:52 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10 Jul 03 14:08:52 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:52 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_768381fb-1532-4d59-b031-afac70d3c781_cddvt0ls" returned: 0 in 0.847s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_768381fb-1532-4d59-b031-afac70d3c781_cddvt0ls {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:52 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_768381fb-1532-4d59-b031-afac70d3c781_cddvt0ls Jul 03 14:08:52 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:53 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.706s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:53 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Deleted volume successfully. Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-ba2eba58-a3ef-4f73-a522-1764cf048a7d tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-97a39c1b-cf08-4312-bcf2-8cc797bc0724-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:53 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10" returned: 0 in 0.652s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.381s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-132572986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858d35da-5abd-47a8-aee3-144b3a7ff85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72035ddc72442719e6c8232c1d3e235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:42Z,use_quota=True,user_id='593deefe6a914fae8482d32eaad89de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Creating volume 858d35da-5abd-47a8-aee3-144b3a7ff85e {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:53 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-858d35da-5abd-47a8-aee3-144b3a7ff85e 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:53 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-858d35da-5abd-47a8-aee3-144b3a7ff85e 1073741824 Jul 03 14:08:53 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd34eb3-5bb3-4b95-9df5-a73b7d0f540d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7069f8-2d60-43c4-80ca-61b375baafe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:53 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10 (91d5ff94-1f39-47e6-b80d-c3fccc79dd10): created successfully Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7069f8-2d60-43c4-80ca-61b375baafe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Flow 'volume_create_manager' (0c55e636-f3e2-4973-a9c1-c38efdb70a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:53 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-2bac5f96-f3cd-4188-9c31-2917a5c8174e tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Created volume successfully. Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "cinder-ccf25f42-5eea-48ec-9eee-8857440806cf-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-ccf25f42-5eea-48ec-9eee-8857440806cf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:53 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_768381fb-1532-4d59-b031-afac70d3c781_cddvt0ls" returned: 1 in 0.778s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_768381fb-1532-4d59-b031-afac70d3c781_cddvt0ls' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ccde3b-39cf-484b-9cae-4fa75c9c2d6b]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "cinder-quobyte-ccf25f42-5eea-48ec-9eee-8857440806cf" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-quobyte-ccf25f42-5eea-48ec-9eee-8857440806cf" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a39039-4805-4da0-bee9-69c6c8dadec0]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ccf25f42-5eea-48ec-9eee-8857440806cf {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:53 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD Jul 03 14:08:53 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:53 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ccf25f42-5eea-48ec-9eee-8857440806cf Jul 03 14:08:53 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:54 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-858d35da-5abd-47a8-aee3-144b3a7ff85e 1073741824" returned: 0 in 0.830s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-858d35da-5abd-47a8-aee3-144b3a7ff85e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:54 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-858d35da-5abd-47a8-aee3-144b3a7ff85e Jul 03 14:08:54 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:54 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:54 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ccf25f42-5eea-48ec-9eee-8857440806cf" returned: 0 in 0.776s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ccf25f42-5eea-48ec-9eee-8857440806cf {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:54 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ccf25f42-5eea-48ec-9eee-8857440806cf Jul 03 14:08:54 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:54 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD Jul 03 14:08:54 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:54 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-858d35da-5abd-47a8-aee3-144b3a7ff85e" returned: 0 in 0.725s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.605s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-223244838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5fb3f3-d83d-450c-a691-24d842a6bb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72035ddc72442719e6c8232c1d3e235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:42Z,use_quota=True,user_id='593deefe6a914fae8482d32eaad89de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Creating volume 6f5fb3f3-d83d-450c-a691-24d842a6bb33 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:54 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4407af6f-4fca-4d41-8616-e6e5bc721705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-858d35da-5abd-47a8-aee3-144b3a7ff85e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:54 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33 1073741824 Jul 03 14:08:54 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab26954-e5a3-4b6e-bfbf-8e06d7726a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:55 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume volume-858d35da-5abd-47a8-aee3-144b3a7ff85e (858d35da-5abd-47a8-aee3-144b3a7ff85e): created successfully Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab26954-e5a3-4b6e-bfbf-8e06d7726a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Flow 'volume_create_manager' (920685f8-42b4-4624-9c89-a3d862afcea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:55 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-90eae982-b426-4ee7-8b38-dd54bed0db6a tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Created volume successfully. Jul 03 14:08:55 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ccf25f42-5eea-48ec-9eee-8857440806cf" returned: 0 in 0.686s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-quobyte-ccf25f42-5eea-48ec-9eee-8857440806cf" released by "delete_volume" :: held 1.522s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Created reservations ['23d2789f-e5ea-431f-aebc-06fcdb5dda64', '666a5701-d540-4bce-a02e-1839727390a5', 'a5fff052-5160-4d7b-9e9d-fa032a184204', '14fc7c30-6168-40dd-9bd9-36b4cf8e470c'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:55 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD" returned: 1 in 0.801s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] 768381fb-1532-4d59-b031-afac70d3c781 was raw, converting to raw {{(pid=86729) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:55 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 Jul 03 14:08:55 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:55 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:08:55 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "cinder-485b723f-4e9a-4527-aab2-0139f299bff5-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-485b723f-4e9a-4527-aab2-0139f299bff5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "cinder-quobyte-485b723f-4e9a-4527-aab2-0139f299bff5" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-quobyte-485b723f-4e9a-4527-aab2-0139f299bff5" acquired by "delete_volume" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afd4d07-1ba9-477d-a3dd-adbdf2cf49e5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-485b723f-4e9a-4527-aab2-0139f299bff5 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:55 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.726s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:55 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:56 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Deleted volume successfully. Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-43345480-ef37-4f9e-a8d8-3693efa7e04e tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-ccf25f42-5eea-48ec-9eee-8857440806cf-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:56 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-485b723f-4e9a-4527-aab2-0139f299bff5 Jul 03 14:08:56 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:56 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33 1073741824" returned: 0 in 1.165s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:56 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02" returned: 0 in 1.001s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_768381fb-1532-4d59-b031-afac70d3c781_opec2k5ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:08:56 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:56 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33 Jul 03 14:08:56 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:56 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 1G Jul 03 14:08:56 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:56 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-485b723f-4e9a-4527-aab2-0139f299bff5" returned: 0 in 0.822s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-485b723f-4e9a-4527-aab2-0139f299bff5 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:56 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-485b723f-4e9a-4527-aab2-0139f299bff5 Jul 03 14:08:56 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:56 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 1G" returned: 0 in 0.701s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:56 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[101a7b4a-684a-4b5f-a189-af17a06f7233]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33" returned: 0 in 0.791s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.259s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1376188150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d396100e-7161-4879-854d-6fe86e20d9aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72035ddc72442719e6c8232c1d3e235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:43Z,use_quota=True,user_id='593deefe6a914fae8482d32eaad89de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Creating volume d396100e-7161-4879-854d-6fe86e20d9aa {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:56 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d396100e-7161-4879-854d-6fe86e20d9aa 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bfedb7-06ea-4054-81a9-dd01d125a967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea87b35c-782f-48a0-9f6c-2d64a6fed138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:57 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d396100e-7161-4879-854d-6fe86e20d9aa 1073741824 Jul 03 14:08:57 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:57 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33 (6f5fb3f3-d83d-450c-a691-24d842a6bb33): created successfully Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea87b35c-782f-48a0-9f6c-2d64a6fed138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:57 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 Jul 03 14:08:57 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Flow 'volume_create_manager' (c6ca2b41-5882-4f7e-b65b-8221499a535b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:57 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b758c2b4-2151-4126-97e9-0a6aae90f652 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Created volume successfully. Jul 03 14:08:57 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-485b723f-4e9a-4527-aab2-0139f299bff5" returned: 0 in 0.738s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-quobyte-485b723f-4e9a-4527-aab2-0139f299bff5" released by "delete_volume" :: held 1.616s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Created reservations ['32aec208-3fc4-4db4-a2eb-579cc24cd8b1', 'b73f3d3c-0963-4dc3-9336-01415e9a0a4b', '63cac368-f5ca-41fc-932a-46b2a1fbdea1', '48b77aa9-c179-4b8f-8787-3fe53c967ad4'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:57 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:08:57 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:57 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02" returned: 0 in 0.904s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:57 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d396100e-7161-4879-854d-6fe86e20d9aa 1073741824" returned: 0 in 0.893s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d396100e-7161-4879-854d-6fe86e20d9aa {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:57 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d396100e-7161-4879-854d-6fe86e20d9aa Jul 03 14:08:57 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:57 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 Jul 03 14:08:57 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:58 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.860s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:08:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Deleted volume successfully. Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-907fe730-ea82-4125-9902-0a16ee44c528 tempest-CreateVolumesFromImageTest-1961996991 None] Lock "cinder-485b723f-4e9a-4527-aab2-0139f299bff5-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:08:58 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02" returned: 1 in 0.925s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Downloaded image 768381fb-1532-4d59-b031-afac70d3c781 ((None, [{'url': 'file:///opt/stack/data/glance/images/768381fb-1532-4d59-b031-afac70d3c781', 'metadata': {}}])) to volume e899587a-311b-49e6-9e91-1f23670bfb02 successfully. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Temporary image 768381fb-1532-4d59-b031-afac70d3c781 for user a39e84ee47df41568f32cf42cf8ccddd is deleted. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Marking volume e899587a-311b-49e6-9e91-1f23670bfb02 as bootable. {{(pid=86729) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Copying metadata from image 768381fb-1532-4d59-b031-afac70d3c781 to e899587a-311b-49e6-9e91-1f23670bfb02. {{(pid=86729) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Creating volume glance metadata for volume e899587a-311b-49e6-9e91-1f23670bfb02 backed by image 768381fb-1532-4d59-b031-afac70d3c781 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '768381fb-1532-4d59-b031-afac70d3c781', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '21c1eea69c557b7eb7ed9a715b5816f7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86729) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:08:58 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d396100e-7161-4879-854d-6fe86e20d9aa" returned: 0 in 0.903s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.818s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1811037942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a096b34d-9a0e-4aa7-b4aa-010017b7e818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72035ddc72442719e6c8232c1d3e235',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:43Z,use_quota=True,user_id='593deefe6a914fae8482d32eaad89de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Creating volume a096b34d-9a0e-4aa7-b4aa-010017b7e818 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:08:58 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:58 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818 1073741824 Jul 03 14:08:58 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf24fc8-361e-4e6d-916c-c769cd79d6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d396100e-7161-4879-854d-6fe86e20d9aa', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7fe84b-1752-4962-b407-1bd841ba1d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:58 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume volume-d396100e-7161-4879-854d-6fe86e20d9aa (d396100e-7161-4879-854d-6fe86e20d9aa): created successfully Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7fe84b-1752-4962-b407-1bd841ba1d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Flow 'volume_create_manager' (f98c86ae-1170-4126-a551-2d069abdf977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451f14ea-b632-48c2-8c44-f9777a6da34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e899587a-311b-49e6-9e91-1f23670bfb02', 'volume_size': 1, 'image_id': '768381fb-1532-4d59-b031-afac70d3c781', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/768381fb-1532-4d59-b031-afac70d3c781', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21c1eea69c557b7eb7ed9a715b5816f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '321a6d6da0e9414c8be04b72bd6c774c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98f2decd3bd12c9b139ba5c45862f9b1b138aa99162c9a1133db3579fc1e11b7bbeed565dff896c688c423cc55dfcc1e0b65c3d721cc7fad2ae6219586b11be6', 'id': '768381fb-1532-4d59-b031-afac70d3c781', 'created_at': datetime.datetime(2026, 7, 3, 12, 8, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 8, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/768381fb-1532-4d59-b031-afac70d3c781/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92bd9cda-94b5-4eaa-8376-972abfeb5935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:08:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e05a2610-7da9-4233-a5ce-ee8a94da83c1 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Created volume successfully. Jul 03 14:08:58 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Volume volume-e899587a-311b-49e6-9e91-1f23670bfb02 (e899587a-311b-49e6-9e91-1f23670bfb02): created successfully Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92bd9cda-94b5-4eaa-8376-972abfeb5935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:08:58 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Flow 'volume_create_manager' (70d116a9-85c6-41ec-99d5-cc1be2dd320b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:08:59 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-5b09f0fb-b842-45b2-bc9e-1e3ca631c011 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Created volume successfully. Jul 03 14:08:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Acquiring lock "cinder-e899587a-311b-49e6-9e91-1f23670bfb02-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Lock "cinder-e899587a-311b-49e6-9e91-1f23670bfb02-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Acquiring lock "cinder-quobyte-e899587a-311b-49e6-9e91-1f23670bfb02" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:08:59 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Lock "cinder-quobyte-e899587a-311b-49e6-9e91-1f23670bfb02" acquired by "delete_volume" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:08:59 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69aecf7-c6f2-4796-b772-4862c9d6382c]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:08:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:59 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 Jul 03 14:08:59 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:08:59 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 03 14:08:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818 1073741824" returned: 0 in 1.022s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:08:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:08:59 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818 Jul 03 14:08:59 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:00 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02" returned: 0 in 0.808s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:00 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 Jul 03 14:09:00 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:00 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818" returned: 0 in 0.716s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.036s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-651386703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07892a68-781c-48e1-ba96-0520f0f22ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f1be1fbd484709baff21ee687b10d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:50Z,use_quota=True,user_id='91ff7c2f6a634cb09e51ee7aa0c08dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Creating volume 07892a68-781c-48e1-ba96-0520f0f22ec3 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:00 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-07892a68-781c-48e1-ba96-0520f0f22ec3 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:00 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-07892a68-781c-48e1-ba96-0520f0f22ec3 1073741824 Jul 03 14:09:00 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e46b8e21-385e-452d-927f-d17eb617c64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca8b4a2-525e-49f6-af52-730777222896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:00 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Volume volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818 (a096b34d-9a0e-4aa7-b4aa-010017b7e818): created successfully Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca8b4a2-525e-49f6-af52-730777222896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:00 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Flow 'volume_create_manager' (d7dce78c-9e3d-4886-b898-3df2640fe3a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:00 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-991afb2a-c053-410c-ace9-914797b9cdf3 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Created volume successfully. Jul 03 14:09:01 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02" returned: 1 in 0.840s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:01 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02 Jul 03 14:09:01 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:01 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-07892a68-781c-48e1-ba96-0520f0f22ec3 1073741824" returned: 0 in 0.940s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-07892a68-781c-48e1-ba96-0520f0f22ec3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:01 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-07892a68-781c-48e1-ba96-0520f0f22ec3 Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "cinder-a096b34d-9a0e-4aa7-b4aa-010017b7e818-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:01 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-a096b34d-9a0e-4aa7-b4aa-010017b7e818-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "cinder-quobyte-a096b34d-9a0e-4aa7-b4aa-010017b7e818" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-quobyte-a096b34d-9a0e-4aa7-b4aa-010017b7e818" acquired by "delete_volume" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd55538c-adb6-4dc3-9852-8d187d3142a4]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:01 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-e899587a-311b-49e6-9e91-1f23670bfb02" returned: 0 in 0.801s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Lock "cinder-quobyte-e899587a-311b-49e6-9e91-1f23670bfb02" released by "delete_volume" :: held 2.520s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:01 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818 Jul 03 14:09:01 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:01 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Created reservations ['10ceab11-b302-4dbe-92a8-dcccc9f617db', 'b2b88994-1cc5-4bc2-bdd1-75bf2397f10a', '60cbbdbb-8380-49e4-b14a-44af7da057d0', '2d80d9a5-c689-475e-86bc-dd5a42f4a917'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:02 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:02 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:02 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-07892a68-781c-48e1-ba96-0520f0f22ec3" returned: 0 in 0.752s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.445s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-483371993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4b857a-14d4-4b78-8505-fd865bfb48a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f1be1fbd484709baff21ee687b10d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:51Z,use_quota=True,user_id='91ff7c2f6a634cb09e51ee7aa0c08dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Creating volume 6d4b857a-14d4-4b78-8505-fd865bfb48a1 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:02 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171d4115-9167-46a8-8050-bd19c5fee915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07892a68-781c-48e1-ba96-0520f0f22ec3', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7a73c8-fac6-45e4-8bcc-1fbe8ebfa1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:02 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1 1073741824 Jul 03 14:09:02 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:02 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume volume-07892a68-781c-48e1-ba96-0520f0f22ec3 (07892a68-781c-48e1-ba96-0520f0f22ec3): created successfully Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7a73c8-fac6-45e4-8bcc-1fbe8ebfa1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Flow 'volume_create_manager' (426bd1d9-3733-4ee5-aa9e-f0d45f0503f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (8c3e1f9c-eea6-4946-b170-a88952bad249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8107a634-edd8-4159-922e-40d3657e503d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8107a634-edd8-4159-922e-40d3657e503d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485367629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189b82ca-463a-49b4-991b-2ce07557340e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:02Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae59d1a4-2703-4e96-9ba4-66dff17cf614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae59d1a4-2703-4e96-9ba4-66dff17cf614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330705a5-ad4d-47a5-be18-7e531d0d5f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330705a5-ad4d-47a5-be18-7e531d0d5f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '189b82ca-463a-49b4-991b-2ce07557340e', 'volume_name': 'volume-189b82ca-463a-49b4-991b-2ce07557340e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3878c0-842d-4a32-8009-14b20a1c468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3878c0-842d-4a32-8009-14b20a1c468d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c51df6a-0a8f-4542-9615-33862704c946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:02 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Volume 189b82ca-463a-49b4-991b-2ce07557340e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-189b82ca-463a-49b4-991b-2ce07557340e', 'volume_size': 1} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:02 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-50547137-8a19-493e-bf3a-c19da8fda61c tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created volume successfully. Jul 03 14:09:02 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818" returned: 0 in 1.123s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:03 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818 Jul 03 14:09:03 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:03 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.965s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:03 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:03 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Deleted volume successfully. Jul 03 14:09:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788b51-fe57-4ea7-a138-6ca3305d0cb3 tempest-VolumeAndVolumeTypeFromImageTest-683994576 None] Lock "cinder-e899587a-311b-49e6-9e91-1f23670bfb02-delete_volume" released by "delete_volume" :: held 3.825s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:03 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1 1073741824" returned: 0 in 1.129s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:03 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1 Jul 03 14:09:03 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:03 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a096b34d-9a0e-4aa7-b4aa-010017b7e818" returned: 0 in 0.876s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-quobyte-a096b34d-9a0e-4aa7-b4aa-010017b7e818" released by "delete_volume" :: held 2.057s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:03 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Created reservations ['4b0d9beb-781a-49c4-8c3a-1b9c4c37fb1f', '25f52cf8-8b31-4a39-ab3d-dae563107d9a', 'cee7d7a4-4f46-4cd0-a1c1-0c2b15b86ce0', 'ff983e19-577d-43cf-9581-f83b5a276bf2'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:04 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:04 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:04 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1" returned: 0 in 0.758s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.931s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-261489251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94031ad3-a73c-4a36-9612-04e51a2ce224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f1be1fbd484709baff21ee687b10d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:51Z,use_quota=True,user_id='91ff7c2f6a634cb09e51ee7aa0c08dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Creating volume 94031ad3-a73c-4a36-9612-04e51a2ce224 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:04 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94031ad3-a73c-4a36-9612-04e51a2ce224 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4c83be-2cd7-4173-9a1c-853c6559ab52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:04 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94031ad3-a73c-4a36-9612-04e51a2ce224 1073741824 Jul 03 14:09:04 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4c8e3d-cfd8-4d1e-95da-dec68155e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:04 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1 (6d4b857a-14d4-4b78-8505-fd865bfb48a1): created successfully Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4c8e3d-cfd8-4d1e-95da-dec68155e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Flow 'volume_create_manager' (051923d4-c954-4d2f-ae21-3717d0db72a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-989c4131-8d98-4634-b185-fdb18052a475 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created volume successfully. Jul 03 14:09:04 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.756s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Deleted volume successfully. Jul 03 14:09:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-54825dbc-5b79-407a-8cdd-51311fad48ca tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-a096b34d-9a0e-4aa7-b4aa-010017b7e818-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "cinder-d396100e-7161-4879-854d-6fe86e20d9aa-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-d396100e-7161-4879-854d-6fe86e20d9aa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "cinder-quobyte-d396100e-7161-4879-854d-6fe86e20d9aa" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-quobyte-d396100e-7161-4879-854d-6fe86e20d9aa" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:05 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6756d0b-2e9a-480d-8071-cd6b70bdf1aa]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d396100e-7161-4879-854d-6fe86e20d9aa {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:05 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d396100e-7161-4879-854d-6fe86e20d9aa Jul 03 14:09:05 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:05 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94031ad3-a73c-4a36-9612-04e51a2ce224 1073741824" returned: 0 in 1.071s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94031ad3-a73c-4a36-9612-04e51a2ce224 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:05 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94031ad3-a73c-4a36-9612-04e51a2ce224 Jul 03 14:09:05 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:06 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d396100e-7161-4879-854d-6fe86e20d9aa" returned: 0 in 0.896s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d396100e-7161-4879-854d-6fe86e20d9aa {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:06 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d396100e-7161-4879-854d-6fe86e20d9aa Jul 03 14:09:06 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:06 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94031ad3-a73c-4a36-9612-04e51a2ce224" returned: 0 in 0.755s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.371s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-746719149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f1be1fbd484709baff21ee687b10d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:52Z,use_quota=True,user_id='91ff7c2f6a634cb09e51ee7aa0c08dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Creating volume a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:06 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3f5921-2a17-4e33-8eec-fd35dd89a460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94031ad3-a73c-4a36-9612-04e51a2ce224', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:06 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb 1073741824 Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fe7edc-ab21-475b-957d-7e9ba70f611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:06 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:06 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume volume-94031ad3-a73c-4a36-9612-04e51a2ce224 (94031ad3-a73c-4a36-9612-04e51a2ce224): created successfully Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fe7edc-ab21-475b-957d-7e9ba70f611c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Flow 'volume_create_manager' (19d772a5-980a-4741-a7a3-1f9e2639c81b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:06 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-54d5bc80-f65a-4141-bea7-dae7f3482a92 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created volume successfully. Jul 03 14:09:06 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d396100e-7161-4879-854d-6fe86e20d9aa" returned: 0 in 0.707s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-quobyte-d396100e-7161-4879-854d-6fe86e20d9aa" released by "delete_volume" :: held 1.661s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Created reservations ['b8250723-ea13-4565-8e16-7f86b44ad6c7', '53530af3-9d0a-4ddd-812c-5e765643eb0f', 'c4e65e93-0a9e-4a4b-9f68-f891f5ec0c6e', '81d40ec2-d975-4320-912f-95fd90f4d333'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:07 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:07 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:07 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb 1073741824" returned: 0 in 0.906s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:07 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb Jul 03 14:09:07 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "cinder-6f5fb3f3-d83d-450c-a691-24d842a6bb33-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-6f5fb3f3-d83d-450c-a691-24d842a6bb33-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "cinder-quobyte-6f5fb3f3-d83d-450c-a691-24d842a6bb33" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-quobyte-6f5fb3f3-d83d-450c-a691-24d842a6bb33" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[105470c0-f033-40eb-938d-0a172fe6fda7]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:07 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33 Jul 03 14:09:07 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:07 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.812s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:07 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Deleted volume successfully. Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6c746a43-d5d2-4b4b-b0ef-1177fc3ef5e0 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-d396100e-7161-4879-854d-6fe86e20d9aa-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Flow 'volume_create_manager' (99e35e20-e466-4fca-bf72-6c4c698f0585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adff547-78cb-41cf-b8da-8bfb28120e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adff547-78cb-41cf-b8da-8bfb28120e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-119815102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53eb2904-2cf0-42ba-af38-536bd10d3864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfcf639641c04601b76380d55c299bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:08Z,use_quota=True,user_id='517c6d5466db4901a13b8f040f9eaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:07 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64448b27-9fee-4791-90cc-63a1332449af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64448b27-9fee-4791-90cc-63a1332449af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc49b269-85b7-4db8-863e-bba77e6075e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc49b269-85b7-4db8-863e-bba77e6075e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53eb2904-2cf0-42ba-af38-536bd10d3864', 'volume_name': 'volume-53eb2904-2cf0-42ba-af38-536bd10d3864', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3ef3eb-67e3-45c3-9db5-0afcc0a9411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3ef3eb-67e3-45c3-9db5-0afcc0a9411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1bcd1c-ab66-4fdb-8928-f979b3f04364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:08 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Volume 53eb2904-2cf0-42ba-af38-536bd10d3864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53eb2904-2cf0-42ba-af38-536bd10d3864', 'volume_size': 1} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:08 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb" returned: 0 in 0.900s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.851s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922911235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f1be1fbd484709baff21ee687b10d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:08:52Z,use_quota=True,user_id='91ff7c2f6a634cb09e51ee7aa0c08dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Creating volume 3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:08 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:08 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc 1073741824 Jul 03 14:09:08 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560e6954-c8a8-4400-aa56-489a33966d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5f108d-2090-405e-af0a-453ff619ae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:08 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb (a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb): created successfully Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5f108d-2090-405e-af0a-453ff619ae7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Flow 'volume_create_manager' (525aec41-e1b4-458c-a572-378b59b13357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:08 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-74c4c005-30b4-4108-aa61-a0ff4c8d3cf2 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created volume successfully. Jul 03 14:09:08 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33" returned: 0 in 0.833s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:08 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33 Jul 03 14:09:08 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:08 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc 1073741824" returned: 0 in 0.825s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:08 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6f5fb3f3-d83d-450c-a691-24d842a6bb33" returned: 0 in 0.636s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-quobyte-6f5fb3f3-d83d-450c-a691-24d842a6bb33" released by "delete_volume" :: held 1.531s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:09 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc Jul 03 14:09:09 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Created reservations ['9a16bb44-0a63-4f52-a291-5714e93e5593', '2df91c8c-4b6c-48b1-9026-4f885689dc97', '396be71d-a6c0-4e00-8935-813278a904c0', '29c308b1-9f29-4540-b851-95e947a861c4'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:09 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:09 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "cinder-858d35da-5abd-47a8-aee3-144b3a7ff85e-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-858d35da-5abd-47a8-aee3-144b3a7ff85e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "cinder-quobyte-858d35da-5abd-47a8-aee3-144b3a7ff85e" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:09 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc" returned: 0 in 0.670s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.047s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485367629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189b82ca-463a-49b4-991b-2ce07557340e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:02Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Creating volume 189b82ca-463a-49b4-991b-2ce07557340e {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:09 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:09 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e 1073741824 Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-quobyte-858d35da-5abd-47a8-aee3-144b3a7ff85e" acquired by "delete_volume" :: waited 0.058s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:09 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c91d4f-943c-44ec-8428-23b92f7ec370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6c6c6e-54fa-4d59-85e2-ca63bd74649d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ff6334-616b-412d-90c4-8b382e159b05]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-858d35da-5abd-47a8-aee3-144b3a7ff85e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:09 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Volume volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc (3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc): created successfully Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6c6c6e-54fa-4d59-85e2-ca63bd74649d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Flow 'volume_create_manager' (96d9ee35-425f-4509-b70a-164a8a7128e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:09 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-cbb35930-cc29-4ac9-8e58-7c829896b32d tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created volume successfully. Jul 03 14:09:09 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.704s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:09 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Deleted volume successfully. Jul 03 14:09:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7377d6fd-23ec-4bf9-a8d4-f92ba1c7b3fc tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-6f5fb3f3-d83d-450c-a691-24d842a6bb33-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:09 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-858d35da-5abd-47a8-aee3-144b3a7ff85e Jul 03 14:09:09 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:10 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:10 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e 1073741824" returned: 0 in 0.842s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-858d35da-5abd-47a8-aee3-144b3a7ff85e" returned: 0 in 0.783s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-858d35da-5abd-47a8-aee3-144b3a7ff85e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:10 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-858d35da-5abd-47a8-aee3-144b3a7ff85e Jul 03 14:09:10 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:10 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e Jul 03 14:09:10 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-quobyte-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0094fc5-02a1-4864-8cc9-55683e4adfa7]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:11 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc Jul 03 14:09:11 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:11 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-858d35da-5abd-47a8-aee3-144b3a7ff85e" returned: 0 in 0.670s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-quobyte-858d35da-5abd-47a8-aee3-144b3a7ff85e" released by "delete_volume" :: held 1.507s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:11 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e" returned: 0 in 0.690s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.249s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-119815102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53eb2904-2cf0-42ba-af38-536bd10d3864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfcf639641c04601b76380d55c299bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:08Z,use_quota=True,user_id='517c6d5466db4901a13b8f040f9eaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Creating volume 53eb2904-2cf0-42ba-af38-536bd10d3864 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:11 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Created reservations ['aabf7d76-e080-4b82-a10e-3c06728fa2f5', 'f906669a-dc92-4ffa-9cae-5a06796cc3a5', '39f69a33-490f-4e42-9cd8-72e1b7d0d832', 'fdbab033-f97c-4dd9-9bc3-90aa99bf7626'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c51df6a-0a8f-4542-9615-33862704c946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189b82ca-463a-49b4-991b-2ce07557340e', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:11 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 1073741824 Jul 03 14:09:11 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89e66b5-fb57-4a5a-9b97-862c610c54bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:11 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Volume volume-189b82ca-463a-49b4-991b-2ce07557340e (189b82ca-463a-49b4-991b-2ce07557340e): created successfully Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89e66b5-fb57-4a5a-9b97-862c610c54bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (8c3e1f9c-eea6-4946-b170-a88952bad249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:11 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9040b04e-1340-4457-ab5e-7bcea33c3ca9 tempest-ProjectMemberTests-1023125764 None] Created volume successfully. Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:11 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:11 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "cinder-91d5ff94-1f39-47e6-b80d-c3fccc79dd10-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-91d5ff94-1f39-47e6-b80d-c3fccc79dd10-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "cinder-quobyte-91d5ff94-1f39-47e6-b80d-c3fccc79dd10" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-quobyte-91d5ff94-1f39-47e6-b80d-c3fccc79dd10" acquired by "delete_volume" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:11 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc" returned: 0 in 0.900s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdc237d-e82c-40a8-88b2-057c7fdd1af7]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:12 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc Jul 03 14:09:12 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:12 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10 Jul 03 14:09:12 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:12 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.728s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:12 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Deleted volume successfully. Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3063c527-d8b2-49aa-9687-ac13755299de tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-858d35da-5abd-47a8-aee3-144b3a7ff85e-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:12 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 1073741824" returned: 0 in 1.108s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:12 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 Jul 03 14:09:12 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:12 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc" returned: 0 in 0.816s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc" released by "delete_volume" :: held 1.783s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created reservations ['54f542be-b5c0-4607-9b7e-811ca7fd1931', '9902fac6-6912-46fc-b595-e860633d6154', 'b69d61e5-0ee8-426a-9bb0-5c018ebbeb12', 'b8f549d7-49ca-4099-94d2-f0795ead830c'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:12 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:12 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:12 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10" returned: 0 in 0.988s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:12 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10 Jul 03 14:09:12 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:13 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864" returned: 0 in 0.779s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.573s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1bcd1c-ab66-4fdb-8928-f979b3f04364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53eb2904-2cf0-42ba-af38-536bd10d3864', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9247fe36-c2cc-41da-9e01-f981dc470e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] Creating offline snapshot d8df816a-0a39-44bd-b91f-ec35405d735a of volume 189b82ca-463a-49b4-991b-2ce07557340e {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:09:13 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Volume volume-53eb2904-2cf0-42ba-af38-536bd10d3864 (53eb2904-2cf0-42ba-af38-536bd10d3864): created successfully Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9247fe36-c2cc-41da-9e01-f981dc470e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Flow 'volume_create_manager' (99e35e20-e466-4fca-bf72-6c4c698f0585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d582a38f-6f31-44c2-974c-80c2a010756b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-016dbb04-bc7a-4155-a21d-8306bc1874c1 tempest-VolumeDependencyTests-1014761582 None] Created volume successfully. Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-quobyte-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb" acquired by "delete_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91f2b80-a67d-4070-9f45-5ae218dbd937]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:13 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e Jul 03 14:09:13 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:13 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb Jul 03 14:09:13 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:13 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:13 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-91d5ff94-1f39-47e6-b80d-c3fccc79dd10" returned: 0 in 0.762s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.819s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Deleted volume successfully. Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-quobyte-91d5ff94-1f39-47e6-b80d-c3fccc79dd10" released by "delete_volume" :: held 1.810s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-291c7cc4-94fc-4714-af5f-980a72122a65 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-3ce2eea8-038c-4c3e-9fd0-5fc2ac8632dc-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Created reservations ['407ac3d4-d58e-4cd5-a567-da757c0503f2', '48e77e7f-ce27-4f72-8074-57afa82e915c', '75416b74-a394-445e-bd4f-efbfea1039e7', '968e6dcf-d0d7-443c-aa46-e37936e30d28'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:13 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:13 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "cinder-160e52a1-2870-466a-92ec-aac5ddb208b3-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:14 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e" returned: 0 in 0.843s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-160e52a1-2870-466a-92ec-aac5ddb208b3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:14 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a 1G Jul 03 14:09:14 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "cinder-quobyte-160e52a1-2870-466a-92ec-aac5ddb208b3" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-quobyte-160e52a1-2870-466a-92ec-aac5ddb208b3" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e65ebd-aec3-48c5-800e-c9094baefb33]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-160e52a1-2870-466a-92ec-aac5ddb208b3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:14 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb" returned: 0 in 0.921s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:14 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb Jul 03 14:09:14 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:14 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-160e52a1-2870-466a-92ec-aac5ddb208b3 Jul 03 14:09:14 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:14 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.853s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:14 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Deleted volume successfully. Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c0285d5c-3621-49e0-b41c-486efb0e4433 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-91d5ff94-1f39-47e6-b80d-c3fccc79dd10-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:15 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb" returned: 0 in 0.852s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb" released by "delete_volume" :: held 1.822s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:15 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a 1G" returned: 0 in 1.046s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189b82ca-463a-49b4-991b-2ce07557340e -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:15 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189b82ca-463a-49b4-991b-2ce07557340e -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a Jul 03 14:09:15 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created reservations ['3ce16268-05b7-4cc5-b753-3131f2cc0691', 'e218b093-f1c1-4c87-a975-94f1e715e800', 'd258a4b7-a6b8-4587-9edd-c489f3b3d8cc', '40dd7462-6d5a-4924-a566-2684942242e7'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:15 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-160e52a1-2870-466a-92ec-aac5ddb208b3" returned: 0 in 1.041s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-160e52a1-2870-466a-92ec-aac5ddb208b3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:15 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-160e52a1-2870-466a-92ec-aac5ddb208b3 Jul 03 14:09:15 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:15 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:15 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-94031ad3-a73c-4a36-9612-04e51a2ce224-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-94031ad3-a73c-4a36-9612-04e51a2ce224-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-quobyte-94031ad3-a73c-4a36-9612-04e51a2ce224" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-94031ad3-a73c-4a36-9612-04e51a2ce224" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ae60a9-0fd5-4247-88f5-caeb72d2ced5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94031ad3-a73c-4a36-9612-04e51a2ce224 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:15 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94031ad3-a73c-4a36-9612-04e51a2ce224 Jul 03 14:09:15 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:15 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189b82ca-463a-49b4-991b-2ce07557340e -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a" returned: 0 in 0.792s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:15 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a is being set with open permissions: ugo+rw Jul 03 14:09:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:16 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a Jul 03 14:09:16 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:16 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-160e52a1-2870-466a-92ec-aac5ddb208b3" returned: 0 in 0.721s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-quobyte-160e52a1-2870-466a-92ec-aac5ddb208b3" released by "delete_volume" :: held 1.818s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Created reservations ['5d19d7e0-1ee3-4b3e-b43e-821755f32e65', '74bddcb2-11aa-4cc2-a9e2-c6fa770f9eca', '9c6ec77e-caf7-42ba-b1f6-a7a83bc042c3', '1774041b-08de-4dde-a89d-e989a8ccc5b3'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:16 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:16 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:16 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.899s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:16 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Deleted volume successfully. Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-60ce9b20-f772-48c2-b8ce-3c22f3ac89f0 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-a3db3a75-bb4a-4d5f-9fa9-62e34b0003eb-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:16 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94031ad3-a73c-4a36-9612-04e51a2ce224" returned: 0 in 0.906s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94031ad3-a73c-4a36-9612-04e51a2ce224 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:16 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94031ad3-a73c-4a36-9612-04e51a2ce224 Jul 03 14:09:16 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:16 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a" returned: 0 in 0.724s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:16 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.info Jul 03 14:09:16 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:16 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.778s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:16 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Deleted volume successfully. Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-77bcc114-3a7d-4586-a7b7-26eea8701d19 tempest-CreateVolumesFromSourceVolumeTest-856328308 None] Lock "cinder-160e52a1-2870-466a-92ec-aac5ddb208b3-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:17 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-94031ad3-a73c-4a36-9612-04e51a2ce224" returned: 0 in 0.818s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-94031ad3-a73c-4a36-9612-04e51a2ce224" released by "delete_volume" :: held 1.779s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created reservations ['9a7de5c0-a339-4b07-9654-2dbd3db1e0e3', 'dd67182d-a79c-4b11-9b34-62a0e5cd72c1', 'd5c77f05-ce6c-4c24-9495-9864a0e9c88d', 'd3646e82-8146-488b-acdb-78883a8c9bc1'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:17 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:17 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:17 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.info" returned: 0 in 0.822s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:17 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.info is being set with open permissions: ugo+rw Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:17 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.info Jul 03 14:09:17 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-6d4b857a-14d4-4b78-8505-fd865bfb48a1-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-6d4b857a-14d4-4b78-8505-fd865bfb48a1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-quobyte-6d4b857a-14d4-4b78-8505-fd865bfb48a1" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-6d4b857a-14d4-4b78-8505-fd865bfb48a1" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[904b15bd-1caa-4809-86ec-5917b1c20dbc]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:18 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1 Jul 03 14:09:18 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:18 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.833s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:18 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Deleted volume successfully. Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d6cc7d29-d642-4976-afb4-213ad909fe6e tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-94031ad3-a73c-4a36-9612-04e51a2ce224-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:18 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.info" returned: 0 in 0.858s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.231s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.622s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] Creating offline snapshot bc4a68b0-95d2-4299-9db0-f253aa6e7f96 of volume 53eb2904-2cf0-42ba-af38-536bd10d3864 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:09:18 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e8fdc8fb-600d-4d38-9b1c-c43ddad6eac7 tempest-ProjectMemberTests-1023125764 None] Create snapshot completed successfully Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e770a239-fda2-46ce-8107-62530198d648]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:18 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 Jul 03 14:09:18 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:18 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1" returned: 0 in 0.882s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:18 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1 Jul 03 14:09:18 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-d8df816a-0a39-44bd-b91f-ec35405d735a-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Lock "cinder-d8df816a-0a39-44bd-b91f-ec35405d735a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-189b82ca-463a-49b4-991b-2ce07557340e" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-189b82ca-463a-49b4-991b-2ce07557340e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-d8df816a-0a39-44bd-b91f-ec35405d735a" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-d8df816a-0a39-44bd-b91f-ec35405d735a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Deleting offline snapshot d8df816a-0a39-44bd-b91f-ec35405d735a of volume 189b82ca-463a-49b4-991b-2ce07557340e {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] snapshot_file for this snap is: volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4cc111-7228-49b9-8d9f-872a3a9edb36]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:19 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a Jul 03 14:09:19 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:19 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864" returned: 0 in 0.832s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:19 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 1G Jul 03 14:09:19 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:19 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6d4b857a-14d4-4b78-8505-fd865bfb48a1" returned: 0 in 0.770s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-6d4b857a-14d4-4b78-8505-fd865bfb48a1" released by "delete_volume" :: held 1.698s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created reservations ['da54ef74-3e0e-4cb1-8dd2-31be31a1f441', '7d4e0d91-a3ec-4dc4-8863-e18cea47e237', 'fb5cefb7-daca-4496-b91d-fa616ce86b06', 'f957a89e-a4be-420a-8d60-7a61184ac0bb'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:19 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:19 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:20 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a" returned: 0 in 0.973s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-189b82ca-463a-49b4-991b-2ce07557340e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7495a56-8c8c-43f7-9a53-84cb67eea9d3]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-07892a68-781c-48e1-ba96-0520f0f22ec3-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-07892a68-781c-48e1-ba96-0520f0f22ec3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-quobyte-07892a68-781c-48e1-ba96-0520f0f22ec3" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:20 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e Jul 03 14:09:20 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-07892a68-781c-48e1-ba96-0520f0f22ec3" acquired by "delete_volume" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:20 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 1G" returned: 0 in 1.069s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53eb2904-2cf0-42ba-af38-536bd10d3864 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d890d80-e6cc-4df3-83f8-003401e3e66a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-07892a68-781c-48e1-ba96-0520f0f22ec3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:20 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53eb2904-2cf0-42ba-af38-536bd10d3864 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 Jul 03 14:09:20 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:20 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-07892a68-781c-48e1-ba96-0520f0f22ec3 Jul 03 14:09:20 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:20 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.866s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:20 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Deleted volume successfully. Jul 03 14:09:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4b4e321b-3b5e-465b-9358-37f31cfe4738 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-6d4b857a-14d4-4b78-8505-fd865bfb48a1-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:21 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e" returned: 0 in 0.980s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:21 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53eb2904-2cf0-42ba-af38-536bd10d3864 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96" returned: 0 in 0.751s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:21 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 is being set with open permissions: ugo+rw Jul 03 14:09:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:21 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a Jul 03 14:09:21 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:21 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 Jul 03 14:09:21 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:21 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-07892a68-781c-48e1-ba96-0520f0f22ec3" returned: 0 in 0.957s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-07892a68-781c-48e1-ba96-0520f0f22ec3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:21 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-07892a68-781c-48e1-ba96-0520f0f22ec3 Jul 03 14:09:21 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:21 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96" returned: 0 in 0.696s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:21 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.info Jul 03 14:09:21 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:22 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a" returned: 0 in 0.936s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:22 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a Jul 03 14:09:22 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:22 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-07892a68-781c-48e1-ba96-0520f0f22ec3" returned: 0 in 0.751s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-07892a68-781c-48e1-ba96-0520f0f22ec3" released by "delete_volume" :: held 1.802s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created reservations ['a794bb9d-9ddc-4474-ae1f-3931170b121f', 'fcd36029-bb20-4a00-8f18-b0a8b5393599', 'eb4b0668-9ea4-4931-a083-80a08a72288e', '944590e1-a380-4d93-9e07-b2d45fbf45c8'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:22 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:22 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-47326e69-33a5-4d54-b796-ab7d50056493-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-47326e69-33a5-4d54-b796-ab7d50056493-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-quobyte-00071320-0479-4117-af52-87f69f32422b" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-00071320-0479-4117-af52-87f69f32422b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-quobyte-47326e69-33a5-4d54-b796-ab7d50056493" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-47326e69-33a5-4d54-b796-ab7d50056493" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Deleting offline snapshot 47326e69-33a5-4d54-b796-ab7d50056493 of volume 00071320-0479-4117-af52-87f69f32422b {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] snapshot_file for this snap is: volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8596fc9d-1975-4bfa-911a-f6d941aa0687]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:22 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.info" returned: 0 in 1.010s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:22 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.info is being set with open permissions: ugo+rw Jul 03 14:09:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:22 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 Jul 03 14:09:22 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:22 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.info Jul 03 14:09:22 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:23 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e.d8df816a-0a39-44bd-b91f-ec35405d735a" returned: 0 in 0.923s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Flow 'volume_create_manager' (697f29a2-b74c-4207-9643-8d826a951e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878b6e23-4db5-4b59-baab-be5bee2de097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-d8df816a-0a39-44bd-b91f-ec35405d735a" released by "_delete_snapshot" :: held 4.026s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-189b82ca-463a-49b4-991b-2ce07557340e" released by "delete_snapshot" :: held 4.061s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878b6e23-4db5-4b59-baab-be5bee2de097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1139b67-23d3-4173-a358-43259d021d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa379fe799624b03ae6a93a7b0fd47f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:23Z,use_quota=True,user_id='8b42223180e34e10bc1b7719a21d1bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ff0c82-3dd5-4660-b478-6e0fe660779c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ff0c82-3dd5-4660-b478-6e0fe660779c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44e5810-2b95-451e-ad7e-66a4e2f56fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.image.glance [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Creating Keystone auth plugin from conf {{(pid=86729) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Created reservations ['a8d6c5d1-b865-4d0c-add1-38232c687fba', '75724583-e9c8-4f56-8a76-258ed9cc4aa5', 'a236d57b-1995-4a0a-b1f4-7887e9f894a2', 'f3e7303e-ae7e-467c-885b-1ebde4c6e10b'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:23 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Delete snapshot completed successfully. Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-200271bc-3d4d-4fb7-b565-4e04f0f304aa tempest-ProjectMemberTests-1023125764 None] Lock "cinder-d8df816a-0a39-44bd-b91f-ec35405d735a-delete_snapshot" released by "delete_snapshot" :: held 4.269s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-189b82ca-463a-49b4-991b-2ce07557340e-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Lock "cinder-189b82ca-463a-49b4-991b-2ce07557340e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-189b82ca-463a-49b4-991b-2ce07557340e" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:23 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.115s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-189b82ca-463a-49b4-991b-2ce07557340e" acquired by "delete_volume" :: waited 0.032s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:23 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Deleted volume successfully. Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7c5b1c-f2ee-4a25-b2ce-427f49c8108f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-2e0c530d-7d6c-4809-95e5-f8ad1969c359 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-07892a68-781c-48e1-ba96-0520f0f22ec3-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44e5810-2b95-451e-ad7e-66a4e2f56fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd1139b67-23d3-4173-a358-43259d021d44', 'volume_name': 'volume-d1139b67-23d3-4173-a358-43259d021d44', 'volume_size': 1, 'image_id': 'b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6fe70208ca9e721a02b35d153e24313a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aa379fe799624b03ae6a93a7b0fd47f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6bb5291fdcc56655d9e7cdcc5c9d8725cc646e3e5bcdd19403899bf701c4c1a0d967bebef7cb51987bc3218ce3bbf2b0a53ab96282970819cdc02f3c05a192f4', 'id': 'b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'created_at': datetime.datetime(2026, 7, 3, 12, 9, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 9, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71e1a1e-eff5-4526-bfb4-1a7dce8321cf/file', 'properties': {}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f22dab-90f0-434e-ab46-63444d4d0a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f22dab-90f0-434e-ab46-63444d4d0a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ffb678-211f-40db-92fa-ca091a89379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:23 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Volume d1139b67-23d3-4173-a358-43259d021d44: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d1139b67-23d3-4173-a358-43259d021d44', 'volume_size': 1, 'image_id': 'b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6fe70208ca9e721a02b35d153e24313a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aa379fe799624b03ae6a93a7b0fd47f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6bb5291fdcc56655d9e7cdcc5c9d8725cc646e3e5bcdd19403899bf701c4c1a0d967bebef7cb51987bc3218ce3bbf2b0a53ab96282970819cdc02f3c05a192f4', 'id': 'b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'created_at': datetime.datetime(2026, 7, 3, 12, 9, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 9, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71e1a1e-eff5-4526-bfb4-1a7dce8321cf/file', 'properties': {}}, 'image_service': } Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Trying to clone d1139b67-23d3-4173-a358-43259d021d44 from image b71e1a1e-eff5-4526-bfb4-1a7dce8321cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'metadata': {}}]). {{(pid=86729) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 03 14:09:23 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e Jul 03 14:09:23 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:23 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.info" returned: 0 in 0.835s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.311s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 03 14:09:23 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Image download 0.00 MB at 0.00 MB/s Jul 03 14:09:23 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-05bdd964-46e4-4c8f-913b-e3f2c6abbd98 tempest-VolumeDependencyTests-1014761582 None] Create snapshot completed successfully Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[0073730c-87ee-4b82-b56e-4fd8c1b83c18]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:23 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493" returned: 0 in 1.059s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00071320-0479-4117-af52-87f69f32422b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b421e2-1196-4688-98ba-be20a59ad92b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:23 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD Jul 03 14:09:23 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:24 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b Jul 03 14:09:24 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:24 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e" returned: 0 in 0.835s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:24 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e Jul 03 14:09:24 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:24 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD" returned: 0 in 0.857s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:24 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b" returned: 0 in 0.870s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:24 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 Jul 03 14:09:24 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:24 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD Jul 03 14:09:24 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Flow 'volume_create_manager' (982bdb1f-14d8-4217-860b-12ca443d701d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f5a3ea-2784-466b-8c7a-d730e046f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f5a3ea-2784-466b-8c7a-d730e046f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1695790672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529dda73-e904-4727-bcf8-c340a8563554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfcf639641c04601b76380d55c299bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bc4a68b0-95d2-4299-9db0-f253aa6e7f96,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:25Z,use_quota=True,user_id='517c6d5466db4901a13b8f040f9eaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821606dd-3f41-48ef-ad5e-051b76f7a5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821606dd-3f41-48ef-ad5e-051b76f7a5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5488f47b-ec84-45fa-b719-2db6f402349c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5488f47b-ec84-45fa-b719-2db6f402349c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '529dda73-e904-4727-bcf8-c340a8563554', 'volume_name': 'volume-529dda73-e904-4727-bcf8-c340a8563554', 'volume_size': 1, 'snapshot_id': 'bc4a68b0-95d2-4299-9db0-f253aa6e7f96'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c39e181-2a47-486e-a700-64086bd20ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c39e181-2a47-486e-a700-64086bd20ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea56ef0b-caaf-43dd-979e-a6a0e87a36e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:25 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Volume 529dda73-e904-4727-bcf8-c340a8563554: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-529dda73-e904-4727-bcf8-c340a8563554', 'volume_size': 1, 'snapshot_id': 'bc4a68b0-95d2-4299-9db0-f253aa6e7f96'} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "cinder-quobyte-bc4a68b0-95d2-4299-9db0-f253aa6e7f96-529dda73-e904-4727-bcf8-c340a8563554" by "_create_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-quobyte-bc4a68b0-95d2-4299-9db0-f253aa6e7f96-529dda73-e904-4727-bcf8-c340a8563554" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Creating volume 529dda73-e904-4727-bcf8-c340a8563554 from snapshot bc4a68b0-95d2-4299-9db0-f253aa6e7f96 {{(pid=86729) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "cinder-quobyte-529dda73-e904-4727-bcf8-c340a8563554" by "_copy_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-quobyte-529dda73-e904-4727-bcf8-c340a8563554" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] snapshot: bc4a68b0-95d2-4299-9db0-f253aa6e7f96, volume: 529dda73-e904-4727-bcf8-c340a8563554, {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:25 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-189b82ca-463a-49b4-991b-2ce07557340e" returned: 0 in 0.856s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[77179097-8d4f-40d4-8726-68a3231ae507]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-189b82ca-463a-49b4-991b-2ce07557340e" released by "delete_volume" :: held 1.793s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Created reservations ['9494d03f-c3fc-48cb-a2dc-75bb6941f629', '703d20ba-9ec7-4eb4-bd14-4f29c041dd80', 'd3c742ed-0898-4e9a-a064-ad27287a2633', '8e38f6ff-a9fc-4b8f-a3c9-d416651b6539'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:25 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 Jul 03 14:09:25 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:25 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:25 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:25 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:25 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD" returned: 1 in 1.004s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493" returned: 0 in 0.941s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Temporary image b71e1a1e-eff5-4526-bfb4-1a7dce8321cf is fetched for user 8b42223180e34e10bc1b7719a21d1bed. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:25 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493 Jul 03 14:09:25 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bde54b7-e5b6-4a27-ab5e-006bc9a657ee]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:26 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD Jul 03 14:09:26 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:26 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:26 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:26 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96" returned: 0 in 1.066s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53eb2904-2cf0-42ba-af38-536bd10d3864(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] will copy from snapshot at /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Creating direct copy from snapshot {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70cffc6-d1aa-4a65-9032-d1bfdf0cba53]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:26 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.020s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:26 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Deleted volume successfully. Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d14ffb75-a92c-4f7d-a6d5-891063e2c89c tempest-ProjectMemberTests-1023125764 None] Lock "cinder-189b82ca-463a-49b4-991b-2ce07557340e-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:26 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 Jul 03 14:09:26 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (a4b9818c-2dc2-418a-a513-c7966ac1738f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a75e370-700f-42c0-8c0e-7bc968dd7155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:26 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b.47326e69-33a5-4d54-b796-ab7d50056493" returned: 0 in 1.036s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a75e370-700f-42c0-8c0e-7bc968dd7155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461453869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa266895-d7fa-4e8e-9969-35ebba1057e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:27Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa50f783-25b0-40a8-b8d0-67c7c3a1e352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa50f783-25b0-40a8-b8d0-67c7c3a1e352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81bf0311-ae45-47d7-8239-efade63f4de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81bf0311-ae45-47d7-8239-efade63f4de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa266895-d7fa-4e8e-9969-35ebba1057e1', 'volume_name': 'volume-aa266895-d7fa-4e8e-9969-35ebba1057e1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538fbe46-2dc7-40e1-85f5-fae7e9a271d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538fbe46-2dc7-40e1-85f5-fae7e9a271d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e55864-88e5-4c31-a66e-3172af5b208c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:26 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Volume aa266895-d7fa-4e8e-9969-35ebba1057e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa266895-d7fa-4e8e-9969-35ebba1057e1', 'volume_size': 1} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-47326e69-33a5-4d54-b796-ab7d50056493" released by "_delete_snapshot" :: held 4.105s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-00071320-0479-4117-af52-87f69f32422b" released by "delete_snapshot" :: held 4.136s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:26 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD" returned: 0 in 1.061s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:26 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created reservations ['6b190e1a-4d6b-49f5-96fb-a8f90358ba1e', '02a8bf1c-9d39-41eb-9847-cfcc582cd087', 'abccb324-fc07-4ac6-9e78-9a24e79984ef', 'f7caf869-9f08-4540-9cb3-81a0f903253b'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:26 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Delete snapshot completed successfully. Jul 03 14:09:27 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-366de9a5-81d0-4576-8482-e13dd02494a9 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-47326e69-33a5-4d54-b796-ab7d50056493-delete_snapshot" released by "delete_snapshot" :: held 4.340s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:27 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.970s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:27 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:27 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD Jul 03 14:09:27 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:27 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864" returned: 0 in 1.028s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:27 devstack cinder-volume[86729]: DEBUG cinder.utils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Path /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554 not found in is_blk_device check {{(pid=86729) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:09:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:27 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554 Jul 03 14:09:27 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:27 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD" returned: 1 in 0.825s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-00071320-0479-4117-af52-87f69f32422b-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-00071320-0479-4117-af52-87f69f32422b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "cinder-quobyte-00071320-0479-4117-af52-87f69f32422b" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-00071320-0479-4117-af52-87f69f32422b" acquired by "delete_volume" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:28 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95766bd-67fc-4aa6-b99d-0851af4ee741]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:28 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b Jul 03 14:09:28 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:29 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b" returned: 0 in 1.150s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:29 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b Jul 03 14:09:29 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:30 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-00071320-0479-4117-af52-87f69f32422b" returned: 0 in 1.239s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-quobyte-00071320-0479-4117-af52-87f69f32422b" released by "delete_volume" :: held 2.490s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:30 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=224,cinder:SELECT=148,cinder:INSERT=55,cinder:DELETE=24 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:09:30 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Created reservations ['931bb401-46d4-4f54-96c2-957c2825149f', 'fbaa7aa8-9684-4e01-877b-9838ed635031', '839fc4b2-f580-4e2b-a99b-fadfc6c635d5', 'fb2c6e87-58fa-4976-8cd6-7939818747e4'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:30 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=185,cinder:UPDATE=224,cinder:INSERT=61,cinder:DELETE=17 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:09:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:30 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:30 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:31 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.075s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:31 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:31 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Deleted volume successfully. Jul 03 14:09:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-22b56d69-f170-4012-a32c-92e33c9a6d15 tempest-CreateVolumesFromSnapshotTest-1708496540 None] Lock "cinder-00071320-0479-4117-af52-87f69f32422b-delete_volume" released by "delete_volume" :: held 3.939s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:32 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554" returned: 0 in 5.321s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[0271e75b-dfde-4398-88d4-03f1e30d0ebb]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:32 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 Jul 03 14:09:32 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:33 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864" returned: 0 in 0.976s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:33 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:09:33 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Converted 1024.00 MB image at 192.42 MB/s Jul 03 14:09:33 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554 is being set with open permissions: ugo+rw Jul 03 14:09:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:33 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554 Jul 03 14:09:33 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:34 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554" returned: 0 in 0.690s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-quobyte-529dda73-e904-4727-bcf8-c340a8563554" released by "_copy_volume_from_snapshot" :: held 9.218s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-quobyte-bc4a68b0-95d2-4299-9db0-f253aa6e7f96-529dda73-e904-4727-bcf8-c340a8563554" released by "_create_volume_from_snapshot" :: held 9.258s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.274s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.647s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461453869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa266895-d7fa-4e8e-9969-35ebba1057e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:27Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Creating volume aa266895-d7fa-4e8e-9969-35ebba1057e1 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:34 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:34 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 1073741824 Jul 03 14:09:34 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea56ef0b-caaf-43dd-979e-a6a0e87a36e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529dda73-e904-4727-bcf8-c340a8563554', 'volume_size': 1, 'snapshot_id': 'bc4a68b0-95d2-4299-9db0-f253aa6e7f96'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13960f1a-053a-4cf9-aff2-b5f02ae33d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:34 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Volume volume-529dda73-e904-4727-bcf8-c340a8563554 (529dda73-e904-4727-bcf8-c340a8563554): created successfully Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13960f1a-053a-4cf9-aff2-b5f02ae33d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Flow 'volume_create_manager' (982bdb1f-14d8-4217-860b-12ca443d701d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-adac4de5-cf52-4e44-a05f-5b9aa371978a tempest-VolumeDependencyTests-1014761582 None] Created volume successfully. Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "cinder-bc4a68b0-95d2-4299-9db0-f253aa6e7f96-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-bc4a68b0-95d2-4299-9db0-f253aa6e7f96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "cinder-quobyte-53eb2904-2cf0-42ba-af38-536bd10d3864" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-quobyte-53eb2904-2cf0-42ba-af38-536bd10d3864" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "cinder-quobyte-bc4a68b0-95d2-4299-9db0-f253aa6e7f96" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-quobyte-bc4a68b0-95d2-4299-9db0-f253aa6e7f96" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Deleting offline snapshot bc4a68b0-95d2-4299-9db0-f253aa6e7f96 of volume 53eb2904-2cf0-42ba-af38-536bd10d3864 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:09:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] snapshot_file for this snap is: volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:09:35 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[79932ed4-e242-4461-bdf3-64a120f248dc]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:35 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 Jul 03 14:09:35 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:35 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 1073741824" returned: 0 in 0.932s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:35 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 Jul 03 14:09:35 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:35 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96" returned: 0 in 0.801s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:35 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53eb2904-2cf0-42ba-af38-536bd10d3864(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:09:35 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f6ecd1-ff18-44da-a76a-630250e4788d]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:35 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 Jul 03 14:09:35 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e3e29de-a186-438e-a098-93f725ff3e65 tempest-ProjectAdminTests-1859044916 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86729) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 14:09:36 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1" returned: 0 in 0.623s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.325s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1139b67-23d3-4173-a358-43259d021d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa379fe799624b03ae6a93a7b0fd47f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:23Z,use_quota=True,user_id='8b42223180e34e10bc1b7719a21d1bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Creating volume d1139b67-23d3-4173-a358-43259d021d44 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:36 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e55864-88e5-4c31-a66e-3172af5b208c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa266895-d7fa-4e8e-9969-35ebba1057e1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:36 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 1073741824 Jul 03 14:09:36 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f80522-73c6-486d-bcdc-49d4d574ee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:36 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Volume volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 (aa266895-d7fa-4e8e-9969-35ebba1057e1): created successfully Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f80522-73c6-486d-bcdc-49d4d574ee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (a4b9818c-2dc2-418a-a513-c7966ac1738f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:36 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-33274937-af90-45a8-bae2-50751223bca8 tempest-ProjectMemberTests-1023125764 None] Created volume successfully. Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:36 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864" returned: 0 in 0.891s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:36 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 Jul 03 14:09:36 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:37 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 1073741824" returned: 0 in 1.027s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:37 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 Jul 03 14:09:37 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:37 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96" returned: 0 in 0.798s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:37 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96 Jul 03 14:09:37 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:37 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44" returned: 0 in 0.721s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.200s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] Creating offline snapshot b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 of volume aa266895-d7fa-4e8e-9969-35ebba1057e1 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Attempting download of b71e1a1e-eff5-4526-bfb4-1a7dce8321cf ((None, [{'url': 'file:///opt/stack/data/glance/images/b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'metadata': {}}])) to volume d1139b67-23d3-4173-a358-43259d021d44. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff409d4b-27ad-4b40-98e8-208e0900df63]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fd62b6-3bd1-40db-97c5-90460ce903d2]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_371ckodx {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:38 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 Jul 03 14:09:38 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:38 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_371ckodx Jul 03 14:09:38 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:38 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864.bc4a68b0-95d2-4299-9db0-f253aa6e7f96" returned: 0 in 0.908s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-quobyte-bc4a68b0-95d2-4299-9db0-f253aa6e7f96" released by "_delete_snapshot" :: held 3.523s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-quobyte-53eb2904-2cf0-42ba-af38-536bd10d3864" released by "delete_snapshot" :: held 3.556s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:38 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Created reservations ['6e3813b3-b063-436a-be1f-d5ec5bf3ba94', 'e724e9b8-554d-410f-b5ec-64682278ea5a', 'e9343340-d04d-45a0-9561-6c4d180f88e6', '6cd65177-3a38-447c-9069-a5b545978233'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Delete snapshot completed successfully. Jul 03 14:09:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-7a461bbc-7516-4105-9128-ea4c39bbb419 tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-bc4a68b0-95d2-4299-9db0-f253aa6e7f96-delete_snapshot" released by "delete_snapshot" :: held 3.726s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:38 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_371ckodx" returned: 0 in 0.828s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_371ckodx {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:38 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1" returned: 0 in 0.911s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:38 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 1G Jul 03 14:09:38 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:38 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_371ckodx Jul 03 14:09:38 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "cinder-53eb2904-2cf0-42ba-af38-536bd10d3864-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-53eb2904-2cf0-42ba-af38-536bd10d3864-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "cinder-quobyte-53eb2904-2cf0-42ba-af38-536bd10d3864" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-quobyte-53eb2904-2cf0-42ba-af38-536bd10d3864" acquired by "delete_volume" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:39 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8bf298-6798-4bc1-97ae-2d3f3ffefc98]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:39 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 Jul 03 14:09:39 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:39 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_371ckodx" returned: 1 in 0.796s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_371ckodx' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:39 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee03124-19b9-42ca-9667-018506d13918]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:39 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD Jul 03 14:09:39 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:39 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 1G" returned: 0 in 0.967s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:39 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 Jul 03 14:09:39 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:40 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864" returned: 0 in 0.967s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:40 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864 Jul 03 14:09:40 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:40 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD" returned: 0 in 0.898s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:40 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99" returned: 0 in 0.794s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:40 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 is being set with open permissions: ugo+rw Jul 03 14:09:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:40 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD Jul 03 14:09:40 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:40 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 Jul 03 14:09:40 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:41 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-53eb2904-2cf0-42ba-af38-536bd10d3864" returned: 0 in 0.670s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-quobyte-53eb2904-2cf0-42ba-af38-536bd10d3864" released by "delete_volume" :: held 1.729s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Created reservations ['6d91526e-f2a0-4971-8377-a4a79503bdc9', '2038f775-9c57-4bc4-a5f2-62cf5f602eb0', 'f3044fa6-3d72-4655-b8ee-f7cc2176c1c8', '8666850e-6159-4fad-9313-4701fa57d069'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:41 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:41 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:41 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD" returned: 1 in 0.751s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] b71e1a1e-eff5-4526-bfb4-1a7dce8321cf was raw, converting to raw {{(pid=86729) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:41 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99" returned: 0 in 0.685s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:41 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 Jul 03 14:09:41 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:41 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.info Jul 03 14:09:41 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "cinder-529dda73-e904-4727-bcf8-c340a8563554-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-529dda73-e904-4727-bcf8-c340a8563554-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "cinder-quobyte-529dda73-e904-4727-bcf8-c340a8563554" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-quobyte-529dda73-e904-4727-bcf8-c340a8563554" acquired by "delete_volume" :: waited 0.038s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa384d1-ebb3-4d1f-a5bb-09a7ffaee58d]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:41 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554 Jul 03 14:09:41 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:41 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.795s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:42 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:42 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Deleted volume successfully. Jul 03 14:09:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-56336c75-4313-4511-b317-133d5b232368 tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-53eb2904-2cf0-42ba-af38-536bd10d3864-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:42 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.info" returned: 0 in 0.870s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:42 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.info is being set with open permissions: ugo+rw Jul 03 14:09:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:42 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.info Jul 03 14:09:42 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:42 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44" returned: 0 in 0.974s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:42 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b71e1a1e-eff5-4526-bfb4-1a7dce8321cf_2gisdqhgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:09:42 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 14:09:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:42 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 1G Jul 03 14:09:42 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:42 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554" returned: 0 in 0.982s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:42 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554 Jul 03 14:09:42 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:42 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:42 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.info" returned: 0 in 0.782s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.143s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 1G" returned: 0 in 0.762s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:43 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-93af074c-6c08-42ea-ab2b-c8af024fc184 tempest-ProjectMemberTests-1023125764 None] Create snapshot completed successfully Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1333dec-8c72-4741-a722-571fc66445c4]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:43 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 Jul 03 14:09:43 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:43 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-529dda73-e904-4727-bcf8-c340a8563554" returned: 0 in 0.644s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-quobyte-529dda73-e904-4727-bcf8-c340a8563554" released by "delete_volume" :: held 1.689s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Created reservations ['d18b9211-e82c-4f3b-823b-543233a464d7', 'f976f147-a437-473d-908b-693ba500d617', '64c8d208-08cc-4252-8d6f-f5881c2ba749', 'e853d85e-5c39-4287-b80d-168a351fcac5'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:43 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:43 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:43 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44" returned: 0 in 0.747s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:43 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 Jul 03 14:09:43 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-aa266895-d7fa-4e8e-9969-35ebba1057e1" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-aa266895-d7fa-4e8e-9969-35ebba1057e1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Deleting offline snapshot b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 of volume aa266895-d7fa-4e8e-9969-35ebba1057e1 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] snapshot_file for this snap is: volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1d2bcd-9f00-4b43-9f49-be45cdc1b5b4]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:44 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.737s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:44 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Deleted volume successfully. Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3cc39f56-95cc-469e-8277-b731c5b0f74d tempest-VolumeDependencyTests-1014761582 None] Lock "cinder-529dda73-e904-4727-bcf8-c340a8563554-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:44 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 Jul 03 14:09:44 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:44 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44" returned: 1 in 0.984s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Downloaded image b71e1a1e-eff5-4526-bfb4-1a7dce8321cf ((None, [{'url': 'file:///opt/stack/data/glance/images/b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'metadata': {}}])) to volume d1139b67-23d3-4173-a358-43259d021d44 successfully. {{(pid=86729) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Temporary image b71e1a1e-eff5-4526-bfb4-1a7dce8321cf for user 8b42223180e34e10bc1b7719a21d1bed is deleted. {{(pid=86729) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.volume.volume_utils [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Marking volume d1139b67-23d3-4173-a358-43259d021d44 as bootable. {{(pid=86729) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Copying metadata from image b71e1a1e-eff5-4526-bfb4-1a7dce8321cf to d1139b67-23d3-4173-a358-43259d021d44. {{(pid=86729) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Creating volume glance metadata for volume d1139b67-23d3-4173-a358-43259d021d44 backed by image b71e1a1e-eff5-4526-bfb4-1a7dce8321cf with: {'image_id': 'b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6fe70208ca9e721a02b35d153e24313a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86729) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ffb678-211f-40db-92fa-ca091a89379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1139b67-23d3-4173-a358-43259d021d44', 'volume_size': 1, 'image_id': 'b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6fe70208ca9e721a02b35d153e24313a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aa379fe799624b03ae6a93a7b0fd47f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6bb5291fdcc56655d9e7cdcc5c9d8725cc646e3e5bcdd19403899bf701c4c1a0d967bebef7cb51987bc3218ce3bbf2b0a53ab96282970819cdc02f3c05a192f4', 'id': 'b71e1a1e-eff5-4526-bfb4-1a7dce8321cf', 'created_at': datetime.datetime(2026, 7, 3, 12, 9, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 12, 9, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71e1a1e-eff5-4526-bfb4-1a7dce8321cf/file', 'properties': {}}, 'image_service': }' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223a8110-4178-441a-b3a1-427995167757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:44 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Volume volume-d1139b67-23d3-4173-a358-43259d021d44 (d1139b67-23d3-4173-a358-43259d021d44): created successfully Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223a8110-4178-441a-b3a1-427995167757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:44 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Flow 'volume_create_manager' (697f29a2-b74c-4207-9643-8d826a951e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:44 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-fd7ef444-63e3-4380-bd7e-830a0393c605 tempest-VolumeImageDependencyTests-1251646300 None] Created volume successfully. Jul 03 14:09:45 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99" returned: 0 in 0.912s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa266895-d7fa-4e8e-9969-35ebba1057e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:09:45 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d5cfb1-3c22-422e-96f2-44aa5107e28a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:45 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 Jul 03 14:09:45 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:46 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1" returned: 0 in 0.898s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:46 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 Jul 03 14:09:46 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Acquiring lock "cinder-d1139b67-23d3-4173-a358-43259d021d44-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Lock "cinder-d1139b67-23d3-4173-a358-43259d021d44-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Acquiring lock "cinder-quobyte-d1139b67-23d3-4173-a358-43259d021d44" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Lock "cinder-quobyte-d1139b67-23d3-4173-a358-43259d021d44" acquired by "delete_volume" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:46 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9f9f9f-fbe7-4739-b516-a25a9a9af317]: (4, 'raw') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:46 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 Jul 03 14:09:46 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:47 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99" returned: 0 in 0.973s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:47 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99 Jul 03 14:09:47 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:47 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44" returned: 0 in 0.868s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:47 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 Jul 03 14:09:47 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:47 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1.b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99" returned: 0 in 0.864s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99" released by "_delete_snapshot" :: held 3.803s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-aa266895-d7fa-4e8e-9969-35ebba1057e1" released by "delete_snapshot" :: held 3.844s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:48 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Created reservations ['fa40814f-7e62-4b04-86d8-524ee439358b', 'f8372be3-6b30-4fce-bb30-8c5f6b296e2a', '15b1c9aa-58a7-421b-832f-518115efedc8', 'e1d113a5-cd4e-43a4-8da0-c9ff53f5ce4a'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:48 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Delete snapshot completed successfully. Jul 03 14:09:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3bba50e7-f2c2-4368-8e79-11a33c8d9a05 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-b4c9d6ad-a8e7-45f9-a858-f26a4a3fbf99-delete_snapshot" released by "delete_snapshot" :: held 4.077s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:48 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44" returned: 1 in 1.005s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44' failed. Not Retrying. {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 14:09:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:48 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44 Jul 03 14:09:48 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-aa266895-d7fa-4e8e-9969-35ebba1057e1-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-aa266895-d7fa-4e8e-9969-35ebba1057e1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-aa266895-d7fa-4e8e-9969-35ebba1057e1" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:09:48 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-aa266895-d7fa-4e8e-9969-35ebba1057e1" acquired by "delete_volume" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:09:48 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d38a29-072f-4d07-b466-76fcd595d244]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:48 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 Jul 03 14:09:48 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:49 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-d1139b67-23d3-4173-a358-43259d021d44" returned: 0 in 0.778s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Lock "cinder-quobyte-d1139b67-23d3-4173-a358-43259d021d44" released by "delete_volume" :: held 2.750s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:49 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Created reservations ['cb1fc991-c4e5-4591-881f-d535bb0a264a', '8ef12abf-ff9a-46ab-885d-cd73f9a59535', '7470eec7-1fd6-4ab3-b1b0-529608221162', '0b726c69-d28c-412a-8607-f8d519ceedf2'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:49 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:49 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:49 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1" returned: 0 in 0.836s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:49 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1 Jul 03 14:09:49 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:50 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.912s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:50 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Deleted volume successfully. Jul 03 14:09:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6d92da0d-da6a-470b-9733-69685aa9f7af tempest-VolumeImageDependencyTests-1251646300 None] Lock "cinder-d1139b67-23d3-4173-a358-43259d021d44-delete_volume" released by "delete_volume" :: held 3.954s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:50 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-aa266895-d7fa-4e8e-9969-35ebba1057e1" returned: 0 in 0.924s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-aa266895-d7fa-4e8e-9969-35ebba1057e1" released by "delete_volume" :: held 1.847s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:50 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Created reservations ['0b3f4db6-fffc-4f4d-874d-b443c879b250', 'f8f9899a-92e9-463e-8b73-a0b7b2ca7b0e', '94776068-75d8-479f-9a3d-e47004f13ab9', '20464b4e-db66-4309-bb41-33fcbbfc3ea9'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:09:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:50 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:50 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:09:50 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (f3822d6c-fc18-445b-8549-5b1a21355ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169afc29-a944-410d-923c-c7755ad36964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169afc29-a944-410d-923c-c7755ad36964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1135101858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabe77db-d3cd-4f98-99ad-35d148dcbe1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:51Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87361c82-59a0-4938-8496-301200b33c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87361c82-59a0-4938-8496-301200b33c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1faaa4-a91e-4dee-b860-d4542c8147e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1faaa4-a91e-4dee-b860-d4542c8147e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cabe77db-d3cd-4f98-99ad-35d148dcbe1f', 'volume_name': 'volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c379442-8d50-4b6a-b824-38509731b980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c379442-8d50-4b6a-b824-38509731b980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1354f8c-73fa-422c-b4cd-0218534adfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:51 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Volume cabe77db-d3cd-4f98-99ad-35d148dcbe1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f', 'volume_size': 1} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1135101858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabe77db-d3cd-4f98-99ad-35d148dcbe1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:51Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Creating volume cabe77db-d3cd-4f98-99ad-35d148dcbe1f {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:51 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:51 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.862s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:09:51 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f 1073741824 Jul 03 14:09:51 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:51 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Deleted volume successfully. Jul 03 14:09:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a1d2b4b4-0ab4-4e63-b6a6-3523fddb32b9 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-aa266895-d7fa-4e8e-9969-35ebba1057e1-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:09:52 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f 1073741824" returned: 0 in 1.215s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:52 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f Jul 03 14:09:52 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:53 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f" returned: 0 in 0.810s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.078s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1354f8c-73fa-422c-b4cd-0218534adfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b83e52a-335a-48a0-b2b4-598f075dd386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:53 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Volume volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f (cabe77db-d3cd-4f98-99ad-35d148dcbe1f): created successfully Jul 03 14:09:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b83e52a-335a-48a0-b2b4-598f075dd386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (f3822d6c-fc18-445b-8549-5b1a21355ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:53 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c4cc5fc9-7303-45a5-bdff-b021df1d07a2 tempest-ProjectMemberTests-1023125764 None] Created volume successfully. Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Flow 'volume_create_manager' (0be0aa1c-2dfb-45b9-bce3-0ac65d8d9a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2411e6ce-b6ba-4e18-aff5-b66cda48cb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2411e6ce-b6ba-4e18-aff5-b66cda48cb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a9d4ad-efad-4340-9697-898e2068641b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d28167aee704441bd5c8249ce18ca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:54Z,use_quota=True,user_id='1a63aa3d13b64687ab82aeeccc0c1580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7010bf31-102a-4860-a1df-78768a182386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7010bf31-102a-4860-a1df-78768a182386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1453b9-53fd-4269-92c3-63f3e8885156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1453b9-53fd-4269-92c3-63f3e8885156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6a9d4ad-efad-4340-9697-898e2068641b', 'volume_name': 'volume-b6a9d4ad-efad-4340-9697-898e2068641b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03070e13-1785-4f31-bd08-e2dc68dd5dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03070e13-1785-4f31-bd08-e2dc68dd5dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829ca613-b90e-424d-891e-d63aa754e663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:54 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Volume b6a9d4ad-efad-4340-9697-898e2068641b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6a9d4ad-efad-4340-9697-898e2068641b', 'volume_size': 1} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a9d4ad-efad-4340-9697-898e2068641b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d28167aee704441bd5c8249ce18ca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:54Z,use_quota=True,user_id='1a63aa3d13b64687ab82aeeccc0c1580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Creating volume b6a9d4ad-efad-4340-9697-898e2068641b {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:09:54 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6a9d4ad-efad-4340-9697-898e2068641b 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:54 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6a9d4ad-efad-4340-9697-898e2068641b 1073741824 Jul 03 14:09:54 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:55 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6a9d4ad-efad-4340-9697-898e2068641b 1073741824" returned: 0 in 0.982s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6a9d4ad-efad-4340-9697-898e2068641b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:55 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6a9d4ad-efad-4340-9697-898e2068641b Jul 03 14:09:55 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:55 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6a9d4ad-efad-4340-9697-898e2068641b" returned: 0 in 0.715s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:09:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:09:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.094s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:09:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829ca613-b90e-424d-891e-d63aa754e663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a9d4ad-efad-4340-9697-898e2068641b', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705074a8-f155-4f6d-8d67-274d11d40258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] Creating offline snapshot ab2e10f6-0168-4f72-adea-a03ab1a26eb2 of volume cabe77db-d3cd-4f98-99ad-35d148dcbe1f {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:09:56 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5e22de-930d-43df-bca5-59727a5c41df]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:09:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:56 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Volume volume-b6a9d4ad-efad-4340-9697-898e2068641b (b6a9d4ad-efad-4340-9697-898e2068641b): created successfully Jul 03 14:09:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705074a8-f155-4f6d-8d67-274d11d40258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Flow 'volume_create_manager' (0be0aa1c-2dfb-45b9-bce3-0ac65d8d9a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:56 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-9461d069-86ec-4643-ab2f-ed1caf488e16 tempest-CinderUnicodeTest-940400005 None] Created volume successfully. Jul 03 14:09:56 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f Jul 03 14:09:56 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:56 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:56 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Flow 'volume_create_manager' (5bc7cbec-b02c-48b9-840f-9de9565f0321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b29577-7e31-4ea9-9cf4-1733557c6112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f" returned: 0 in 1.001s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b29577-7e31-4ea9-9cf4-1733557c6112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1668459831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c329ec07-8287-43b9-aeee-a65f19cb68c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d28167aee704441bd5c8249ce18ca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:57Z,use_quota=True,user_id='1a63aa3d13b64687ab82aeeccc0c1580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:57 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 1G Jul 03 14:09:57 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6937da-ca6d-405a-81fd-fe70c159dabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6937da-ca6d-405a-81fd-fe70c159dabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba214974-1bf7-447e-882b-8305f89d18d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba214974-1bf7-447e-882b-8305f89d18d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c329ec07-8287-43b9-aeee-a65f19cb68c1', 'volume_name': 'volume-c329ec07-8287-43b9-aeee-a65f19cb68c1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff45d75-8ab5-4d54-af9a-2bbc618fc890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff45d75-8ab5-4d54-af9a-2bbc618fc890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c2d01e-cd9b-4248-bd81-0310530baa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:57 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Volume c329ec07-8287-43b9-aeee-a65f19cb68c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c329ec07-8287-43b9-aeee-a65f19cb68c1', 'volume_size': 1} Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:09:57 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 1G" returned: 0 in 0.980s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:58 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 Jul 03 14:09:58 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:58 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2" returned: 0 in 0.804s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:58 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 is being set with open permissions: ugo+rw Jul 03 14:09:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:58 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 Jul 03 14:09:58 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:59 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2" returned: 0 in 0.677s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:09:59 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.info Jul 03 14:09:59 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Flow 'volume_create_manager' (7cc58f35-0074-41b9-91c0-e7de8d91bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e33be4-8982-445a-a67d-9d6375008333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e33be4-8982-445a-a67d-9d6375008333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1919611983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751e103d-6642-49ee-9933-76c282623cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5e105b3c54452fae45fd567674e88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:59Z,use_quota=True,user_id='95983ef108fb4d568d6b244d0af0355b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5381e223-8b3c-4827-b2b2-9078c4da6e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5381e223-8b3c-4827-b2b2-9078c4da6e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f3943a-7e2f-41b2-9f38-247e611c1be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f3943a-7e2f-41b2-9f38-247e611c1be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '751e103d-6642-49ee-9933-76c282623cea', 'volume_name': 'volume-751e103d-6642-49ee-9933-76c282623cea', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012274a4-14cc-41f7-9f92-1be1b6bb8713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012274a4-14cc-41f7-9f92-1be1b6bb8713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab717c4-11d8-4b4e-899f-89041acbc6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:09:59 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Volume 751e103d-6642-49ee-9933-76c282623cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-751e103d-6642-49ee-9933-76c282623cea', 'volume_size': 1} Jul 03 14:09:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:00 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.info" returned: 0 in 0.677s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:00 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.info is being set with open permissions: ugo+rw Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:00 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.info Jul 03 14:10:00 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:00 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.info" returned: 0 in 0.637s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.885s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.759s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1668459831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c329ec07-8287-43b9-aeee-a65f19cb68c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d28167aee704441bd5c8249ce18ca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:57Z,use_quota=True,user_id='1a63aa3d13b64687ab82aeeccc0c1580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Creating volume c329ec07-8287-43b9-aeee-a65f19cb68c1 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:00 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:10:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:00 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 1073741824 Jul 03 14:10:00 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:00 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-04e5cd78-3721-4c4b-888f-89016cec123f tempest-ProjectMemberTests-1023125764 None] Create snapshot completed successfully Jul 03 14:10:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-ab2e10f6-0168-4f72-adea-a03ab1a26eb2-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Lock "cinder-ab2e10f6-0168-4f72-adea-a03ab1a26eb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-cabe77db-d3cd-4f98-99ad-35d148dcbe1f" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-cabe77db-d3cd-4f98-99ad-35d148dcbe1f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-ab2e10f6-0168-4f72-adea-a03ab1a26eb2" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-ab2e10f6-0168-4f72-adea-a03ab1a26eb2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Deleting offline snapshot ab2e10f6-0168-4f72-adea-a03ab1a26eb2 of volume cabe77db-d3cd-4f98-99ad-35d148dcbe1f {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:10:01 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] snapshot_file for this snap is: volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:10:01 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82997dd-e3cf-4c4f-90fb-d4e8f16c7db4]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:01 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 Jul 03 14:10:01 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:01 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 1073741824" returned: 0 in 0.857s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:01 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 Jul 03 14:10:01 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:02 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2" returned: 0 in 0.795s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d07ba3b-eeae-48cd-b2d5-63077fff738e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:02 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f Jul 03 14:10:02 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:02 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1" returned: 0 in 0.730s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.844s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1919611983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751e103d-6642-49ee-9933-76c282623cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5e105b3c54452fae45fd567674e88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:09:59Z,use_quota=True,user_id='95983ef108fb4d568d6b244d0af0355b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Creating volume 751e103d-6642-49ee-9933-76c282623cea {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:02 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-751e103d-6642-49ee-9933-76c282623cea 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c2d01e-cd9b-4248-bd81-0310530baa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c329ec07-8287-43b9-aeee-a65f19cb68c1', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cd05ef-c19a-4097-937c-82f63c79e6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:02 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-751e103d-6642-49ee-9933-76c282623cea 1073741824 Jul 03 14:10:02 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:02 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Volume volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 (c329ec07-8287-43b9-aeee-a65f19cb68c1): created successfully Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cd05ef-c19a-4097-937c-82f63c79e6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Flow 'volume_create_manager' (5bc7cbec-b02c-48b9-840f-9de9565f0321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:02 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b3466cdd-d2d6-49ca-b232-ffaeb55d907f tempest-CinderUnicodeTest-940400005 None] Created volume successfully. Jul 03 14:10:02 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f" returned: 0 in 0.862s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:02 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 Jul 03 14:10:02 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:03 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-751e103d-6642-49ee-9933-76c282623cea 1073741824" returned: 0 in 1.055s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-751e103d-6642-49ee-9933-76c282623cea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:03 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-751e103d-6642-49ee-9933-76c282623cea Jul 03 14:10:03 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:03 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2" returned: 0 in 0.853s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:03 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2 Jul 03 14:10:03 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:04 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-751e103d-6642-49ee-9933-76c282623cea" returned: 0 in 0.670s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.686s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab717c4-11d8-4b4e-899f-89041acbc6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-751e103d-6642-49ee-9933-76c282623cea', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4217df5c-7bda-4a97-aa9d-57b9e8614ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] Creating offline snapshot f222fa87-dbca-4695-82bc-7e9f7d3d5510 of volume c329ec07-8287-43b9-aeee-a65f19cb68c1 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:10:04 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Volume volume-751e103d-6642-49ee-9933-76c282623cea (751e103d-6642-49ee-9933-76c282623cea): created successfully Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4217df5c-7bda-4a97-aa9d-57b9e8614ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Flow 'volume_create_manager' (7cc58f35-0074-41b9-91c0-e7de8d91bda1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[09261792-57c2-45ba-8ea2-0e35cd03b5e6]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3c9922be-b3da-4517-9c92-1db643778e84 tempest-ProjectReaderTests-1316120783 None] Created volume successfully. Jul 03 14:10:04 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f.ab2e10f6-0168-4f72-adea-a03ab1a26eb2" returned: 0 in 0.682s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:04 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 Jul 03 14:10:04 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-ab2e10f6-0168-4f72-adea-a03ab1a26eb2" released by "_delete_snapshot" :: held 3.296s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-cabe77db-d3cd-4f98-99ad-35d148dcbe1f" released by "delete_snapshot" :: held 3.322s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Created reservations ['9793a17e-2302-4874-8b26-3b71aa89bb6a', '7bfb8617-7943-4519-91ea-3160c0ecf6d9', 'e0d392a7-8fe7-4e7d-b03e-e27ab3ae306c', 'c6a46eba-d60a-4bca-aa6c-e2a8f593090f'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:04 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Delete snapshot completed successfully. Jul 03 14:10:04 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-02fa03db-b862-4f40-891a-4ac80ec6daeb tempest-ProjectMemberTests-1023125764 None] Lock "cinder-ab2e10f6-0168-4f72-adea-a03ab1a26eb2-delete_snapshot" released by "delete_snapshot" :: held 3.499s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Acquiring lock "cinder-751e103d-6642-49ee-9933-76c282623cea-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Lock "cinder-751e103d-6642-49ee-9933-76c282623cea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Acquiring lock "cinder-quobyte-751e103d-6642-49ee-9933-76c282623cea" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Lock "cinder-quobyte-751e103d-6642-49ee-9933-76c282623cea" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d5af96-547f-4432-afd4-449750c5079a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-751e103d-6642-49ee-9933-76c282623cea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:05 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1" returned: 0 in 0.870s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:05 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 1G Jul 03 14:10:05 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:05 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-751e103d-6642-49ee-9933-76c282623cea Jul 03 14:10:05 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-cabe77db-d3cd-4f98-99ad-35d148dcbe1f-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-cabe77db-d3cd-4f98-99ad-35d148dcbe1f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-cabe77db-d3cd-4f98-99ad-35d148dcbe1f" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-cabe77db-d3cd-4f98-99ad-35d148dcbe1f" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba65bac8-0ca6-4bdb-a8a8-86109176ee29]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:05 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f Jul 03 14:10:05 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:05 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-751e103d-6642-49ee-9933-76c282623cea" returned: 0 in 0.803s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-751e103d-6642-49ee-9933-76c282623cea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:06 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-751e103d-6642-49ee-9933-76c282623cea Jul 03 14:10:06 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:06 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 1G" returned: 0 in 0.863s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:06 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 Jul 03 14:10:06 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:06 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f" returned: 0 in 0.884s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:06 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f Jul 03 14:10:06 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:06 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-751e103d-6642-49ee-9933-76c282623cea" returned: 0 in 0.730s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Lock "cinder-quobyte-751e103d-6642-49ee-9933-76c282623cea" released by "delete_volume" :: held 1.587s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Created reservations ['7b48addb-a837-4ed2-8061-2fd066697bf3', '1ddb2ea3-6a1a-4795-bd7a-e7618e62381f', '99910a5b-6a7d-459d-bd37-df104f587ed2', '1381b9ee-e072-405c-bd6a-031d1866e76d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:06 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:06 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:07 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510" returned: 0 in 0.943s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:07 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 is being set with open permissions: ugo+rw Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:07 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 Jul 03 14:10:07 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:07 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cabe77db-d3cd-4f98-99ad-35d148dcbe1f" returned: 0 in 0.758s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-cabe77db-d3cd-4f98-99ad-35d148dcbe1f" released by "delete_volume" :: held 1.737s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Created reservations ['7fee7fc4-badb-47bd-b1ee-2ca12a54839b', 'b83913aa-2c98-49cd-b7b3-0423d2a4bd95', '468332e7-5e5e-4419-88e6-5f7b276303c6', '9ce05df9-5709-4063-887b-5a256a85960d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:07 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:07 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:07 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 1.012s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:07 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Deleted volume successfully. Jul 03 14:10:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-680a3c2f-b895-4ded-9b5f-4e58a858ebcc tempest-ProjectReaderTests-1316120783 None] Lock "cinder-751e103d-6642-49ee-9933-76c282623cea-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:08 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510" returned: 0 in 0.997s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Flow 'volume_create_manager' (4b934173-8424-4f3e-9d37-ff0664b8cc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950d19f2-afde-4fe5-91c7-6a0f2699c31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950d19f2-afde-4fe5-91c7-6a0f2699c31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1815687973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1cdc1b-3f3c-454f-8756-7725cd5307df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5e105b3c54452fae45fd567674e88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:08Z,use_quota=True,user_id='95983ef108fb4d568d6b244d0af0355b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81261913-da97-4a05-899c-5b3b671c14a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:08 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.info Jul 03 14:10:08 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81261913-da97-4a05-899c-5b3b671c14a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee233995-5b1f-4ee5-80ab-727371c42656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee233995-5b1f-4ee5-80ab-727371c42656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1cdc1b-3f3c-454f-8756-7725cd5307df', 'volume_name': 'volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd8a217-6842-47f4-a62a-bbadde0272af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd8a217-6842-47f4-a62a-bbadde0272af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e33fa32-2cfa-4ff3-a03f-ff4bcc2ef3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:08 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Volume ed1cdc1b-3f3c-454f-8756-7725cd5307df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df', 'volume_size': 1} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:08 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.984s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:08 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Deleted volume successfully. Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6694347d-c847-4537-9624-863d70477c58 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-cabe77db-d3cd-4f98-99ad-35d148dcbe1f-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (ea0a2da4-12b5-4aa1-8aff-5e04e7ed2452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02085054-db52-4804-bee7-6298b13fb7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02085054-db52-4804-bee7-6298b13fb7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1811319390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc31029-d09f-4644-8cb7-3506c1de4813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:09Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03715e4c-42fb-4d73-b71c-5db92d5cfb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03715e4c-42fb-4d73-b71c-5db92d5cfb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e4e798-f1ad-4f6e-b118-fc90aa76fdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e4e798-f1ad-4f6e-b118-fc90aa76fdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc31029-d09f-4644-8cb7-3506c1de4813', 'volume_name': 'volume-cfc31029-d09f-4644-8cb7-3506c1de4813', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7924ebeb-1ed4-435b-afd2-208115bd9581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7924ebeb-1ed4-435b-afd2-208115bd9581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6201a571-1c76-4672-90d2-f8ac61cab563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:08 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Volume cfc31029-d09f-4644-8cb7-3506c1de4813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc31029-d09f-4644-8cb7-3506c1de4813', 'volume_size': 1} Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:08 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.info" returned: 0 in 0.792s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:08 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.info is being set with open permissions: ugo+rw Jul 03 14:10:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:08 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.info Jul 03 14:10:08 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:09 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.info" returned: 0 in 0.666s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.373s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.380s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1815687973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1cdc1b-3f3c-454f-8756-7725cd5307df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5e105b3c54452fae45fd567674e88a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:08Z,use_quota=True,user_id='95983ef108fb4d568d6b244d0af0355b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Creating volume ed1cdc1b-3f3c-454f-8756-7725cd5307df {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:09 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:09 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df 1073741824 Jul 03 14:10:09 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:09 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d39fdb6b-a7a6-4d93-8c30-9df6cce7f2d7 tempest-CinderUnicodeTest-940400005 None] Create snapshot completed successfully Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Acquiring lock "cinder-f222fa87-dbca-4695-82bc-7e9f7d3d5510-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Lock "cinder-f222fa87-dbca-4695-82bc-7e9f7d3d5510-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Acquiring lock "cinder-quobyte-c329ec07-8287-43b9-aeee-a65f19cb68c1" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Lock "cinder-quobyte-c329ec07-8287-43b9-aeee-a65f19cb68c1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:09 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Acquiring lock "cinder-quobyte-f222fa87-dbca-4695-82bc-7e9f7d3d5510" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:10 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Lock "cinder-quobyte-f222fa87-dbca-4695-82bc-7e9f7d3d5510" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Deleting offline snapshot f222fa87-dbca-4695-82bc-7e9f7d3d5510 of volume c329ec07-8287-43b9-aeee-a65f19cb68c1 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:10:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] snapshot_file for this snap is: volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:10:10 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9449b65e-d7b2-4b64-9a53-85924f7bbf16]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:10 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 Jul 03 14:10:10 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:10 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df 1073741824" returned: 0 in 0.920s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:10 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df Jul 03 14:10:10 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:10 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510" returned: 0 in 0.833s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c329ec07-8287-43b9-aeee-a65f19cb68c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:10:10 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8dfea5-7bdf-4571-8e94-331d6ba243bd]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:11 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 Jul 03 14:10:11 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:11 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df" returned: 0 in 0.720s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.616s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1811319390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc31029-d09f-4644-8cb7-3506c1de4813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:09Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Creating volume cfc31029-d09f-4644-8cb7-3506c1de4813 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:11 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e33fa32-2cfa-4ff3-a03f-ff4bcc2ef3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:11 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 1073741824 Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12bc071-f205-4fdc-a7ef-867cf4354ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:11 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:11 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Volume volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df (ed1cdc1b-3f3c-454f-8756-7725cd5307df): created successfully Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12bc071-f205-4fdc-a7ef-867cf4354ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Flow 'volume_create_manager' (4b934173-8424-4f3e-9d37-ff0664b8cc65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:11 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-0a1a21d6-9157-47fb-9202-9bf379b4c4d0 tempest-ProjectReaderTests-1316120783 None] Created volume successfully. Jul 03 14:10:11 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1" returned: 0 in 0.838s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:11 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 Jul 03 14:10:11 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Acquiring lock "cinder-ed1cdc1b-3f3c-454f-8756-7725cd5307df-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Lock "cinder-ed1cdc1b-3f3c-454f-8756-7725cd5307df-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Acquiring lock "cinder-quobyte-ed1cdc1b-3f3c-454f-8756-7725cd5307df" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:12 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Lock "cinder-quobyte-ed1cdc1b-3f3c-454f-8756-7725cd5307df" acquired by "delete_volume" :: waited 0.023s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:12 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8619cdd-8a4e-46a9-9de6-17616f800612]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:12 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 1073741824" returned: 0 in 1.060s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:12 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 Jul 03 14:10:12 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:12 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df Jul 03 14:10:12 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:12 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510" returned: 0 in 1.004s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:12 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510 Jul 03 14:10:12 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:13 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813" returned: 0 in 0.835s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6201a571-1c76-4672-90d2-f8ac61cab563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc31029-d09f-4644-8cb7-3506c1de4813', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afeba0a1-3d97-455f-b268-de0c0cbaacb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:13 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df" returned: 0 in 0.942s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:13 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Volume volume-cfc31029-d09f-4644-8cb7-3506c1de4813 (cfc31029-d09f-4644-8cb7-3506c1de4813): created successfully Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afeba0a1-3d97-455f-b268-de0c0cbaacb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (ea0a2da4-12b5-4aa1-8aff-5e04e7ed2452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:13 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df Jul 03 14:10:13 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ec5ac5e6-5859-43fa-883b-3cc283320001 tempest-ProjectMemberTests-1023125764 None] Created volume successfully. Jul 03 14:10:13 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1.f222fa87-dbca-4695-82bc-7e9f7d3d5510" returned: 0 in 0.838s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Lock "cinder-quobyte-f222fa87-dbca-4695-82bc-7e9f7d3d5510" released by "_delete_snapshot" :: held 3.641s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Lock "cinder-quobyte-c329ec07-8287-43b9-aeee-a65f19cb68c1" released by "delete_snapshot" :: held 3.695s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Created reservations ['5c841508-ebbb-488c-a6ba-8c11aa920a50', '9aadd244-6c12-4868-9b25-7fdbcdb63fb6', '2c142928-b73a-4ee0-af59-6c5171486cc2', 'bc62beac-df0d-4de1-962b-c833a7f24e8d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:13 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Delete snapshot completed successfully. Jul 03 14:10:13 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-1c8d0072-224a-429b-bf39-25285b57c4a9 tempest-CinderUnicodeTest-940400005 None] Lock "cinder-f222fa87-dbca-4695-82bc-7e9f7d3d5510-delete_snapshot" released by "delete_snapshot" :: held 3.842s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:14 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-ed1cdc1b-3f3c-454f-8756-7725cd5307df" returned: 0 in 0.696s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Lock "cinder-quobyte-ed1cdc1b-3f3c-454f-8756-7725cd5307df" released by "delete_volume" :: held 1.686s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] Creating offline snapshot 07ce201d-b43e-49d7-a8f7-3e2b621b95ee of volume cfc31029-d09f-4644-8cb7-3506c1de4813 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cf864d-25c6-44db-8cd6-f25d3b60a6f9]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Created reservations ['80a240b4-3f94-46c0-b69d-58163f08c280', '83777270-e4ae-4f26-9468-b330e207f66e', 'a81fa8e9-b870-474b-81bf-0ba88b17c017', '725f541e-3487-450e-8f3b-0f1f7544982b'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:14 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 Jul 03 14:10:14 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:14 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:14 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Acquiring lock "cinder-c329ec07-8287-43b9-aeee-a65f19cb68c1-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Lock "cinder-c329ec07-8287-43b9-aeee-a65f19cb68c1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Acquiring lock "cinder-quobyte-c329ec07-8287-43b9-aeee-a65f19cb68c1" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Lock "cinder-quobyte-c329ec07-8287-43b9-aeee-a65f19cb68c1" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[753d6b7f-6b36-470c-8e66-051e1053b0b5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:14 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 Jul 03 14:10:14 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:14 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813" returned: 0 in 0.879s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:15 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.793s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:15 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:15 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee 1G Jul 03 14:10:15 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:15 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Deleted volume successfully. Jul 03 14:10:15 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a6a0c61a-0dc6-4ee6-9b3e-075cd575d128 tempest-ProjectReaderTests-1316120783 None] Lock "cinder-ed1cdc1b-3f3c-454f-8756-7725cd5307df-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:15 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1" returned: 0 in 0.927s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:15 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1 Jul 03 14:10:15 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:15 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee 1G" returned: 0 in 0.982s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc31029-d09f-4644-8cb7-3506c1de4813 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:15 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc31029-d09f-4644-8cb7-3506c1de4813 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee Jul 03 14:10:15 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:16 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c329ec07-8287-43b9-aeee-a65f19cb68c1" returned: 0 in 0.703s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Lock "cinder-quobyte-c329ec07-8287-43b9-aeee-a65f19cb68c1" released by "delete_volume" :: held 1.708s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Created reservations ['9750e0b6-7452-43a4-b80a-4ca2a28757b2', 'd691ae35-79d6-4875-b4cd-3565efaacddf', '1a8b6464-8b40-4794-aab1-f10129b226a4', '39413996-2b62-4835-83dc-a2858b802344'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:16 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:16 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Acquiring lock "cinder-b6a9d4ad-efad-4340-9697-898e2068641b-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Lock "cinder-b6a9d4ad-efad-4340-9697-898e2068641b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Acquiring lock "cinder-quobyte-b6a9d4ad-efad-4340-9697-898e2068641b" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Lock "cinder-quobyte-b6a9d4ad-efad-4340-9697-898e2068641b" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f582944d-14d3-4941-af40-1370793fc8f9]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6a9d4ad-efad-4340-9697-898e2068641b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:16 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc31029-d09f-4644-8cb7-3506c1de4813 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee" returned: 0 in 0.803s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:16 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee is being set with open permissions: ugo+rw Jul 03 14:10:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:16 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6a9d4ad-efad-4340-9697-898e2068641b Jul 03 14:10:16 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:16 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee Jul 03 14:10:16 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:17 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.762s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:17 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:17 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Deleted volume successfully. Jul 03 14:10:17 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-5a427880-3bbc-4f9c-957f-18d1e83e5d6a tempest-CinderUnicodeTest-940400005 None] Lock "cinder-c329ec07-8287-43b9-aeee-a65f19cb68c1-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:17 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee" returned: 0 in 0.723s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:17 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6a9d4ad-efad-4340-9697-898e2068641b" returned: 0 in 0.866s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6a9d4ad-efad-4340-9697-898e2068641b {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:17 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.info Jul 03 14:10:17 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:17 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6a9d4ad-efad-4340-9697-898e2068641b Jul 03 14:10:17 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:18 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.info" returned: 0 in 0.678s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:18 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.info is being set with open permissions: ugo+rw Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:18 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-b6a9d4ad-efad-4340-9697-898e2068641b" returned: 0 in 0.671s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:18 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.info Jul 03 14:10:18 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Lock "cinder-quobyte-b6a9d4ad-efad-4340-9697-898e2068641b" released by "delete_volume" :: held 1.603s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Created reservations ['4891ea4f-78d4-452b-81e5-0be44e0b8ded', '7c104ae4-e4fa-47ad-875e-c847be6d85a4', 'fe537048-e0d6-400a-a380-3a547c9379bd', '664db74c-9d21-4c95-9c03-26d87c7e29f8'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:18 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:18 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Flow 'volume_create_manager' (03643022-d561-49ac-9b25-73d2268f728f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c84cd4-19eb-40d1-b4b7-9d6c6f9e9d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c84cd4-19eb-40d1-b4b7-9d6c6f9e9d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614338871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b09ecbc-1781-4b20-afe7-e6f2a0e831f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77172a25b50463d8cd477ca45d737e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:19Z,use_quota=True,user_id='29d0b8da388f4762abf7e3787bd58121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddb5427-b35a-4e57-8b2a-9b7eeb87ea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eddb5427-b35a-4e57-8b2a-9b7eeb87ea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b84306-f0c1-4ebd-adbe-636a180f170a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b84306-f0c1-4ebd-adbe-636a180f170a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b09ecbc-1781-4b20-afe7-e6f2a0e831f8', 'volume_name': 'volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc751a3-2972-42f3-95fc-9a46f9608865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc751a3-2972-42f3-95fc-9a46f9608865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f711d9-ac64-46da-8e8a-208f9a27900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:18 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Volume 4b09ecbc-1781-4b20-afe7-e6f2a0e831f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8', 'volume_size': 1} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:18 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.info" returned: 0 in 0.659s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.812s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.034s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614338871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b09ecbc-1781-4b20-afe7-e6f2a0e831f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77172a25b50463d8cd477ca45d737e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:19Z,use_quota=True,user_id='29d0b8da388f4762abf7e3787bd58121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Creating volume 4b09ecbc-1781-4b20-afe7-e6f2a0e831f8 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:18 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:10:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:18 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8 1073741824 Jul 03 14:10:18 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:18 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-4fbbaf40-8b08-464e-b28e-079ffa651c16 tempest-ProjectMemberTests-1023125764 None] Create snapshot completed successfully Jul 03 14:10:19 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.782s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:19 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Deleted volume successfully. Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-47b985c0-a3ad-4fd2-a260-9e2c905e3a3a tempest-CinderUnicodeTest-940400005 None] Lock "cinder-b6a9d4ad-efad-4340-9697-898e2068641b-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-07ce201d-b43e-49d7-a8f7-3e2b621b95ee-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-07ce201d-b43e-49d7-a8f7-3e2b621b95ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-cfc31029-d09f-4644-8cb7-3506c1de4813" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-cfc31029-d09f-4644-8cb7-3506c1de4813" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-07ce201d-b43e-49d7-a8f7-3e2b621b95ee" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-07ce201d-b43e-49d7-a8f7-3e2b621b95ee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Deleting offline snapshot 07ce201d-b43e-49d7-a8f7-3e2b621b95ee of volume cfc31029-d09f-4644-8cb7-3506c1de4813 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] snapshot_file for this snap is: volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5b5a7b-8d72-423c-8475-4854b02469ba]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:19 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee Jul 03 14:10:19 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:19 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8 1073741824" returned: 0 in 0.998s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:19 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8 Jul 03 14:10:19 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:20 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee" returned: 0 in 0.871s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfc31029-d09f-4644-8cb7-3506c1de4813(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:10:20 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ec4d66-50a6-4922-a277-407cf39e2f92]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:20 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 Jul 03 14:10:20 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:20 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8" returned: 0 in 0.822s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f711d9-ac64-46da-8e8a-208f9a27900e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c2635c-51a5-417f-abe4-cc1a61aa84fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:20 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Volume volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8 (4b09ecbc-1781-4b20-afe7-e6f2a0e831f8): created successfully Jul 03 14:10:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c2635c-51a5-417f-abe4-cc1a61aa84fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:20 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Flow 'volume_create_manager' (03643022-d561-49ac-9b25-73d2268f728f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:20 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-989ca17d-5623-4fcb-a469-01e8c47b4faf tempest-ProjectReaderTests-1662531115 None] Created volume successfully. Jul 03 14:10:21 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813" returned: 0 in 0.879s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:21 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee Jul 03 14:10:21 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:22 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee" returned: 0 in 0.770s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:22 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee Jul 03 14:10:22 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Acquiring lock "cinder-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Lock "cinder-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Acquiring lock "cinder-quobyte-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Lock "cinder-quobyte-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8" acquired by "delete_volume" :: waited 0.029s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d051c14-0545-4541-9bab-68bab4438523]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:22 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8 Jul 03 14:10:22 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Flow 'volume_create_manager' (76aa5684-985c-41cd-b358-50e66299474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20289be-b410-4867-9849-65da74d98ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20289be-b410-4867-9849-65da74d98ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1281779989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c3368d-7a64-46f9-b29f-8841746dd999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df96c8c56b1e4b48abbee33cccfac7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:23Z,use_quota=True,user_id='252b13c505a241d6a64f1fa7361fa8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4250fd2f-688e-40d2-b628-6ddd4f979453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4250fd2f-688e-40d2-b628-6ddd4f979453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e128f7-3d0f-4a85-aa97-89793b9bc10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e128f7-3d0f-4a85-aa97-89793b9bc10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c3368d-7a64-46f9-b29f-8841746dd999', 'volume_name': 'volume-c7c3368d-7a64-46f9-b29f-8841746dd999', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71c7973-bf07-4bdc-a15f-f0fe62404a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71c7973-bf07-4bdc-a15f-f0fe62404a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51747e8-6e0c-4767-9b87-318d76151c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:22 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Volume c7c3368d-7a64-46f9-b29f-8841746dd999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c3368d-7a64-46f9-b29f-8841746dd999', 'volume_size': 1} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1281779989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c3368d-7a64-46f9-b29f-8841746dd999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df96c8c56b1e4b48abbee33cccfac7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:23Z,use_quota=True,user_id='252b13c505a241d6a64f1fa7361fa8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Creating volume c7c3368d-7a64-46f9-b29f-8841746dd999 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:22 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:22 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813.07ce201d-b43e-49d7-a8f7-3e2b621b95ee" returned: 0 in 0.747s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:22 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 1073741824 Jul 03 14:10:22 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-07ce201d-b43e-49d7-a8f7-3e2b621b95ee" released by "_delete_snapshot" :: held 3.403s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-cfc31029-d09f-4644-8cb7-3506c1de4813" released by "delete_snapshot" :: held 3.433s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Created reservations ['78b0ac3b-6843-4a22-b003-0ddfe9ee4cd7', 'ea27108f-6e25-41c8-a208-58485b911078', '3082610e-d3ff-4b7c-b129-d4f6ee60365a', '9521e0b6-b424-439d-a37b-9aba82a01afe'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:22 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Delete snapshot completed successfully. Jul 03 14:10:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-a4881c25-be58-45cb-8384-524b2fcef6f3 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-07ce201d-b43e-49d7-a8f7-3e2b621b95ee-delete_snapshot" released by "delete_snapshot" :: held 3.591s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:23 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8" returned: 0 in 0.765s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:23 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8 Jul 03 14:10:23 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:23 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 1073741824" returned: 0 in 0.855s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-cfc31029-d09f-4644-8cb7-3506c1de4813-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-cfc31029-d09f-4644-8cb7-3506c1de4813-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:23 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 Jul 03 14:10:23 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-cfc31029-d09f-4644-8cb7-3506c1de4813" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-cfc31029-d09f-4644-8cb7-3506c1de4813" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:23 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[013c7685-c5bd-4705-9355-4ea29cd83860]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:23 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 Jul 03 14:10:23 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:24 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8" returned: 0 in 0.782s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Lock "cinder-quobyte-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8" released by "delete_volume" :: held 1.617s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Created reservations ['3523e732-2aa4-45bd-81de-dbe1c21452e8', '0a14e11e-6fa6-4359-90ca-14e82169aa73', 'cfd037fd-8bcf-4750-9b12-0038a5afa9d6', '989b2ee2-a5b6-41d1-b456-c6d8c382be5b'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:24 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:24 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:24 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999" returned: 0 in 0.736s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51747e8-6e0c-4767-9b87-318d76151c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c3368d-7a64-46f9-b29f-8841746dd999', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06c9d18-95c9-4db3-9771-0765076776ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:24 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Volume volume-c7c3368d-7a64-46f9-b29f-8841746dd999 (c7c3368d-7a64-46f9-b29f-8841746dd999): created successfully Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06c9d18-95c9-4db3-9771-0765076776ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Flow 'volume_create_manager' (76aa5684-985c-41cd-b358-50e66299474f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:24 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a0bcb25c-82ca-4f79-8f06-e0260be41a63 tempest-ProjectReaderTests-1048536491 None] Created volume successfully. Jul 03 14:10:24 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813" returned: 0 in 0.743s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:24 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813 Jul 03 14:10:24 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] Creating offline snapshot 2ba7b707-130e-4086-9bde-026cb4398904 of volume c7c3368d-7a64-46f9-b29f-8841746dd999 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:10:24 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.776s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:24 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:25 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Deleted volume successfully. Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ebb342-853c-4118-848b-0976ddbd9401]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-4fbd976d-c296-4ff9-a6e0-c71970217436 tempest-ProjectReaderTests-1662531115 None] Lock "cinder-4b09ecbc-1781-4b20-afe7-e6f2a0e831f8-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:25 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 Jul 03 14:10:25 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Flow 'volume_create_manager' (4c83e138-6a09-4a8c-bf73-1b9d67216837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea3e6b8-6f3e-48a1-9510-63d45e000049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea3e6b8-6f3e-48a1-9510-63d45e000049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517802368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78ee869-5fed-4df6-a081-650d62ec3ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77172a25b50463d8cd477ca45d737e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:25Z,use_quota=True,user_id='29d0b8da388f4762abf7e3787bd58121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86f3e94-694c-4844-8165-823eb512054c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:25 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86f3e94-694c-4844-8165-823eb512054c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e232c0-269b-4484-be08-11b2f85bed6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e232c0-269b-4484-be08-11b2f85bed6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a78ee869-5fed-4df6-a081-650d62ec3ee6', 'volume_name': 'volume-a78ee869-5fed-4df6-a081-650d62ec3ee6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be86ae83-5562-4f3a-8719-9845ee9ad82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be86ae83-5562-4f3a-8719-9845ee9ad82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba68f201-8dc0-414c-a66b-b5aa6af6472c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:25 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Volume a78ee869-5fed-4df6-a081-650d62ec3ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a78ee869-5fed-4df6-a081-650d62ec3ee6', 'volume_size': 1} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-cfc31029-d09f-4644-8cb7-3506c1de4813" returned: 0 in 0.876s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-cfc31029-d09f-4644-8cb7-3506c1de4813" released by "delete_volume" :: held 1.668s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Created reservations ['43ceeb19-2945-4ab6-835e-5679cf1eb253', '831e75a2-ff09-4405-8a93-81d435abf863', '6d91477e-858f-4c87-b173-b2c3442e656e', '2f016f74-82f5-4722-bffc-b0cc1f6b44e8'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:25 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:25 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:25 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999" returned: 0 in 0.806s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:25 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 1G Jul 03 14:10:25 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:26 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:26 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:26 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.722s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:26 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Deleted volume successfully. Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-027a7f75-f08b-45d4-aaae-9ef93e835259 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-cfc31029-d09f-4644-8cb7-3506c1de4813-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (22f99bf7-c94e-48bc-8caf-06cc4148553c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c635b959-d89c-422f-9e25-cd9d4eb7fd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c635b959-d89c-422f-9e25-cd9d4eb7fd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-693441740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898cf5b3-0c41-4cd4-9b87-6de111abc9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:26Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b11066f-007a-4a87-a1ec-792ded21122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b11066f-007a-4a87-a1ec-792ded21122f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980aee61-0d81-4a2d-99e7-c12b71eba9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980aee61-0d81-4a2d-99e7-c12b71eba9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '898cf5b3-0c41-4cd4-9b87-6de111abc9d3', 'volume_name': 'volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7db1a33-0955-48d4-be04-56f153b051e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7db1a33-0955-48d4-be04-56f153b051e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aac1e11-0508-4800-b796-d02174d17223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:26 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Volume 898cf5b3-0c41-4cd4-9b87-6de111abc9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3', 'volume_size': 1} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:26 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 1G" returned: 0 in 0.918s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7c3368d-7a64-46f9-b29f-8841746dd999 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:26 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7c3368d-7a64-46f9-b29f-8841746dd999 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 Jul 03 14:10:26 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:26 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.732s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:27 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7c3368d-7a64-46f9-b29f-8841746dd999 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904" returned: 0 in 0.668s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:27 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 is being set with open permissions: ugo+rw Jul 03 14:10:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:27 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 Jul 03 14:10:27 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:28 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904" returned: 0 in 0.630s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:28 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.info Jul 03 14:10:28 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:28 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.info" returned: 0 in 0.637s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:28 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.info is being set with open permissions: ugo+rw Jul 03 14:10:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:28 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.info Jul 03 14:10:28 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:29 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.info" returned: 0 in 0.619s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.378s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.937s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517802368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78ee869-5fed-4df6-a081-650d62ec3ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77172a25b50463d8cd477ca45d737e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:25Z,use_quota=True,user_id='29d0b8da388f4762abf7e3787bd58121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Creating volume a78ee869-5fed-4df6-a081-650d62ec3ee6 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:29 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:29 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:10:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a78ee869-5fed-4df6-a081-650d62ec3ee6 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:29 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a78ee869-5fed-4df6-a081-650d62ec3ee6 1073741824 Jul 03 14:10:29 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:29 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-df460d37-81ac-4daf-a6d5-31b35b4ed4b5 tempest-ProjectReaderTests-1048536491 None] Create snapshot completed successfully Jul 03 14:10:30 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a78ee869-5fed-4df6-a081-650d62ec3ee6 1073741824" returned: 0 in 0.785s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a78ee869-5fed-4df6-a081-650d62ec3ee6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:30 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a78ee869-5fed-4df6-a081-650d62ec3ee6 Jul 03 14:10:30 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-2ba7b707-130e-4086-9bde-026cb4398904-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-2ba7b707-130e-4086-9bde-026cb4398904-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-c7c3368d-7a64-46f9-b29f-8841746dd999" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-c7c3368d-7a64-46f9-b29f-8841746dd999" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-2ba7b707-130e-4086-9bde-026cb4398904" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-2ba7b707-130e-4086-9bde-026cb4398904" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Deleting offline snapshot 2ba7b707-130e-4086-9bde-026cb4398904 of volume c7c3368d-7a64-46f9-b29f-8841746dd999 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] snapshot_file for this snap is: volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21add4a-c609-4080-aabd-56595f951221]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:30 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 Jul 03 14:10:30 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:30 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a78ee869-5fed-4df6-a081-650d62ec3ee6" returned: 0 in 0.674s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.268s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-693441740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898cf5b3-0c41-4cd4-9b87-6de111abc9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:26Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Creating volume 898cf5b3-0c41-4cd4-9b87-6de111abc9d3 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:30 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=174,cinder:DELETE=13,cinder:SELECT=119,cinder:INSERT=36 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:10:30 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3 1073741824 Jul 03 14:10:30 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba68f201-8dc0-414c-a66b-b5aa6af6472c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a78ee869-5fed-4df6-a081-650d62ec3ee6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848a7e76-6df9-41d4-a43c-65596040b860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:INSERT=54,cinder:UPDATE=156,cinder:SELECT=124,cinder:DELETE=15 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:10:30 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Volume volume-a78ee869-5fed-4df6-a081-650d62ec3ee6 (a78ee869-5fed-4df6-a081-650d62ec3ee6): created successfully Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848a7e76-6df9-41d4-a43c-65596040b860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:30 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Flow 'volume_create_manager' (4c83e138-6a09-4a8c-bf73-1b9d67216837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:30 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-68a2d9b8-3aaa-4206-b6a2-96b005b3e1d8 tempest-ProjectReaderTests-1662531115 None] Created volume successfully. Jul 03 14:10:31 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904" returned: 0 in 0.777s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7c3368d-7a64-46f9-b29f-8841746dd999(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:10:31 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f6e883-d1f2-4337-8ba5-e36a5fab4bbb]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:31 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 Jul 03 14:10:31 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Acquiring lock "cinder-a78ee869-5fed-4df6-a081-650d62ec3ee6-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Lock "cinder-a78ee869-5fed-4df6-a081-650d62ec3ee6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:31 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3 1073741824" returned: 0 in 0.902s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Acquiring lock "cinder-quobyte-a78ee869-5fed-4df6-a081-650d62ec3ee6" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Lock "cinder-quobyte-a78ee869-5fed-4df6-a081-650d62ec3ee6" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:31 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d03c8f5-6965-4e37-9a0f-16a122424f24]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a78ee869-5fed-4df6-a081-650d62ec3ee6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:31 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3 Jul 03 14:10:31 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:31 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a78ee869-5fed-4df6-a081-650d62ec3ee6 Jul 03 14:10:31 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:32 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999" returned: 0 in 0.824s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:32 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 Jul 03 14:10:32 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:32 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3" returned: 0 in 0.746s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aac1e11-0508-4800-b796-d02174d17223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e52401d-73df-41f3-bd13-8911b5e277f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:32 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Volume volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3 (898cf5b3-0c41-4cd4-9b87-6de111abc9d3): created successfully Jul 03 14:10:32 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e52401d-73df-41f3-bd13-8911b5e277f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (22f99bf7-c94e-48bc-8caf-06cc4148553c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a78ee869-5fed-4df6-a081-650d62ec3ee6" returned: 0 in 0.825s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a78ee869-5fed-4df6-a081-650d62ec3ee6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:32 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3e04dcb3-0519-4545-915d-355153df62db tempest-ProjectMemberTests-1023125764 None] Created volume successfully. Jul 03 14:10:32 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a78ee869-5fed-4df6-a081-650d62ec3ee6 Jul 03 14:10:32 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:32 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904" returned: 0 in 0.768s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:32 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904 Jul 03 14:10:32 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] Creating offline snapshot 63f53743-e665-436a-af37-1cf607cd4fbd of volume 898cf5b3-0c41-4cd4-9b87-6de111abc9d3 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfda5b5-0641-435c-b418-49b35b7e5c92]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:33 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3 Jul 03 14:10:33 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:33 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a78ee869-5fed-4df6-a081-650d62ec3ee6" returned: 0 in 0.671s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Lock "cinder-quobyte-a78ee869-5fed-4df6-a081-650d62ec3ee6" released by "delete_volume" :: held 1.540s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Created reservations ['4b9f8dbe-784e-49fd-ae36-48906a10677c', '4ca561f6-6376-43cf-8f39-ba02291bd582', '880adfa7-69f3-4425-9244-9db0562e18ad', '917230df-dbf1-4923-9057-183d756ff62c'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:33 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:33 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:33 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999.2ba7b707-130e-4086-9bde-026cb4398904" returned: 0 in 0.770s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-2ba7b707-130e-4086-9bde-026cb4398904" released by "_delete_snapshot" :: held 3.236s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-c7c3368d-7a64-46f9-b29f-8841746dd999" released by "delete_snapshot" :: held 3.259s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Created reservations ['8aa959b3-7a0a-4dce-bf47-d576eac63b89', '0416f63f-e42b-46a7-aa40-f3384b3e62c6', '7ffc6344-89ab-493d-a963-ee2443c737ee', '8aa5d09d-1ff8-4c4b-bf8d-d9ee0fb1a204'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:33 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Delete snapshot completed successfully. Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6820af56-fa5a-48f9-b368-aac36826a4a0 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-2ba7b707-130e-4086-9bde-026cb4398904-delete_snapshot" released by "delete_snapshot" :: held 3.409s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:33 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3" returned: 0 in 0.805s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.63f53743-e665-436a-af37-1cf607cd4fbd 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:33 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.63f53743-e665-436a-af37-1cf607cd4fbd 1G Jul 03 14:10:33 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:34 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.755s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Deleted volume successfully. Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d68a673c-2a55-4f11-a342-3ec105eff63b tempest-ProjectReaderTests-1662531115 None] Lock "cinder-a78ee869-5fed-4df6-a081-650d62ec3ee6-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Flow 'volume_create_manager' (d5cbe745-311e-44dd-8c9b-adce9e0aa83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d98ffb-c477-4429-a840-b4686e4124df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d98ffb-c477-4429-a840-b4686e4124df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1542291778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb37cfc6-37e9-43e8-a9ba-45d1089f107f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77172a25b50463d8cd477ca45d737e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:34Z,use_quota=True,user_id='29d0b8da388f4762abf7e3787bd58121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d83caef-b176-48a0-b366-a89cd55f9df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d83caef-b176-48a0-b366-a89cd55f9df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f0e3ec-40b3-49e5-89ce-183a70fab8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f0e3ec-40b3-49e5-89ce-183a70fab8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb37cfc6-37e9-43e8-a9ba-45d1089f107f', 'volume_name': 'volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d9d7e0-9ba3-4a40-bbed-76a73b29121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d9d7e0-9ba3-4a40-bbed-76a73b29121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b95e13-6b90-4a91-996d-d7cf13cb33a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:34 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Volume fb37cfc6-37e9-43e8-a9ba-45d1089f107f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f', 'volume_size': 1} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-c7c3368d-7a64-46f9-b29f-8841746dd999-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-c7c3368d-7a64-46f9-b29f-8841746dd999-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-c7c3368d-7a64-46f9-b29f-8841746dd999" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-c7c3368d-7a64-46f9-b29f-8841746dd999" acquired by "delete_volume" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52c5cbc-d2f5-4f8f-95f5-253950e62aa4]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:34 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 Jul 03 14:10:34 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:34 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.63f53743-e665-436a-af37-1cf607cd4fbd 1G" returned: 0 in 0.940s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.63f53743-e665-436a-af37-1cf607cd4fbd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:34 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.63f53743-e665-436a-af37-1cf607cd4fbd Jul 03 14:10:34 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:35 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.63f53743-e665-436a-af37-1cf607cd4fbd" returned: 0 in 0.678s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:35 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.63f53743-e665-436a-af37-1cf607cd4fbd is being set with open permissions: ugo+rw Jul 03 14:10:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.63f53743-e665-436a-af37-1cf607cd4fbd {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:35 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999" returned: 0 in 0.823s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:35 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.63f53743-e665-436a-af37-1cf607cd4fbd Jul 03 14:10:35 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:35 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999 Jul 03 14:10:35 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:36 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.63f53743-e665-436a-af37-1cf607cd4fbd" returned: 0 in 0.631s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:36 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-c7c3368d-7a64-46f9-b29f-8841746dd999" returned: 0 in 0.651s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:36 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.info Jul 03 14:10:36 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-c7c3368d-7a64-46f9-b29f-8841746dd999" released by "delete_volume" :: held 1.536s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Created reservations ['913a6970-e725-4def-b59b-07c6f5e819ea', '0b3be788-d3b9-454c-a6cd-985b45bb8d22', 'c68a7ee5-d36a-4566-96d3-7e8411085065', '3fa9e8cd-c5b1-4921-ae99-7987ba206b3e'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:36 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:36 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:36 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.info" returned: 0 in 0.687s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:36 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.info is being set with open permissions: ugo+rw Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:36 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.info Jul 03 14:10:36 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:36 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.675s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:36 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:36 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Deleted volume successfully. Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f6b39916-6e20-40a6-b3d6-b5ed9bf6d5e9 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-c7c3368d-7a64-46f9-b29f-8841746dd999-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Flow 'volume_create_manager' (f039428e-a5c5-408b-8a68-0d1d5f81af4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7247a2-80d1-4583-a3c2-f05c5070738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7247a2-80d1-4583-a3c2-f05c5070738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1824526189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fd8db1-24d9-42d7-ab17-e62932a00846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df96c8c56b1e4b48abbee33cccfac7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:37Z,use_quota=True,user_id='252b13c505a241d6a64f1fa7361fa8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d19f77-f558-43d2-8f24-602fb9608660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d19f77-f558-43d2-8f24-602fb9608660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b26ada-f54a-4153-9b5f-e4de01dc2ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b26ada-f54a-4153-9b5f-e4de01dc2ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9fd8db1-24d9-42d7-ab17-e62932a00846', 'volume_name': 'volume-f9fd8db1-24d9-42d7-ab17-e62932a00846', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6181ef58-e90f-4f33-bbfa-b5245e47e06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6181ef58-e90f-4f33-bbfa-b5245e47e06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227c0211-1ba1-424c-bf14-bb04624fc14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:37 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Volume f9fd8db1-24d9-42d7-ab17-e62932a00846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9fd8db1-24d9-42d7-ab17-e62932a00846', 'volume_size': 1} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:37 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-898cf5b3-0c41-4cd4-9b87-6de111abc9d3.info" returned: 0 in 0.658s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.473s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.012s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1542291778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb37cfc6-37e9-43e8-a9ba-45d1089f107f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77172a25b50463d8cd477ca45d737e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:34Z,use_quota=True,user_id='29d0b8da388f4762abf7e3787bd58121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Creating volume fb37cfc6-37e9-43e8-a9ba-45d1089f107f {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:37 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:10:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:37 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f 1073741824 Jul 03 14:10:37 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:37 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c4798b73-15a8-4a8a-8053-f93337ceb7d4 tempest-ProjectMemberTests-1023125764 None] Create snapshot completed successfully Jul 03 14:10:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3a60e67c-2922-437a-97cc-ffe5e62b2bd5 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-63f53743-e665-436a-af37-1cf607cd4fbd-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3a60e67c-2922-437a-97cc-ffe5e62b2bd5 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-63f53743-e665-436a-af37-1cf607cd4fbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:38 devstack cinder-volume[86729]: INFO cinder.message.api [None req-3a60e67c-2922-437a-97cc-ffe5e62b2bd5 tempest-ProjectMemberTests-1023125764 None] Creating message record for request_id = req-3a60e67c-2922-437a-97cc-ffe5e62b2bd5 Jul 03 14:10:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3a60e67c-2922-437a-97cc-ffe5e62b2bd5 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-63f53743-e665-436a-af37-1cf607cd4fbd-delete_snapshot" released by "delete_snapshot" :: held 0.039s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server [None req-3a60e67c-2922-437a-97cc-ffe5e62b2bd5 tempest-ProjectMemberTests-1023125764 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 219, in wrapper Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 14:10:38 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server Jul 03 14:10:38 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f 1073741824" returned: 0 in 0.850s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:38 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f Jul 03 14:10:38 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:39 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f" returned: 0 in 0.623s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.673s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1824526189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fd8db1-24d9-42d7-ab17-e62932a00846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df96c8c56b1e4b48abbee33cccfac7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:37Z,use_quota=True,user_id='252b13c505a241d6a64f1fa7361fa8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Creating volume f9fd8db1-24d9-42d7-ab17-e62932a00846 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:39 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:39 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 1073741824 Jul 03 14:10:39 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b95e13-6b90-4a91-996d-d7cf13cb33a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b042cc-1984-4356-b748-303e2733f2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:39 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Volume volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f (fb37cfc6-37e9-43e8-a9ba-45d1089f107f): created successfully Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b042cc-1984-4356-b748-303e2733f2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Flow 'volume_create_manager' (d5cbe745-311e-44dd-8c9b-adce9e0aa83e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:39 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e5aadd2e-2bef-4151-81a1-c58b73da1343 tempest-ProjectReaderTests-1662531115 None] Created volume successfully. Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Acquiring lock "cinder-fb37cfc6-37e9-43e8-a9ba-45d1089f107f-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Lock "cinder-fb37cfc6-37e9-43e8-a9ba-45d1089f107f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Acquiring lock "cinder-quobyte-fb37cfc6-37e9-43e8-a9ba-45d1089f107f" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Lock "cinder-quobyte-fb37cfc6-37e9-43e8-a9ba-45d1089f107f" acquired by "delete_volume" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8547bad7-013f-4c95-ad43-aaeabf8894dd]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:39 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f Jul 03 14:10:39 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:39 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 1073741824" returned: 0 in 0.919s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:40 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 Jul 03 14:10:40 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:40 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f" returned: 0 in 0.786s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:40 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f Jul 03 14:10:40 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:40 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846" returned: 0 in 0.673s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227c0211-1ba1-424c-bf14-bb04624fc14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fd8db1-24d9-42d7-ab17-e62932a00846', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e063e1e2-177f-4192-b750-9167da4ef68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:40 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Volume volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 (f9fd8db1-24d9-42d7-ab17-e62932a00846): created successfully Jul 03 14:10:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e063e1e2-177f-4192-b750-9167da4ef68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Flow 'volume_create_manager' (f039428e-a5c5-408b-8a68-0d1d5f81af4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:40 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a7a0ed58-b543-4723-9c0a-9f48fdf7f8de tempest-ProjectReaderTests-1048536491 None] Created volume successfully. Jul 03 14:10:41 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-fb37cfc6-37e9-43e8-a9ba-45d1089f107f" returned: 0 in 0.634s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Lock "cinder-quobyte-fb37cfc6-37e9-43e8-a9ba-45d1089f107f" released by "delete_volume" :: held 1.460s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Created reservations ['3e1245e5-e95a-4706-9496-d1bba23c5cb7', '1be3099c-4adf-4309-b329-ea709b54d181', 'c18e1b3f-20cb-45d0-8ec2-75856996a392', 'ca521d49-1e1f-4100-a690-3bc7a724c171'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:41 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:41 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] Creating offline snapshot d1bf74be-eec3-463a-84aa-77569057bbc2 of volume f9fd8db1-24d9-42d7-ab17-e62932a00846 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf611a4-19c4-4ce5-9c5c-43c0b738d35b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:41 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 Jul 03 14:10:41 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:42 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.664s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:42 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Deleted volume successfully. Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-842afae4-0e67-4f44-a5a1-c0ef5f92820a tempest-ProjectReaderTests-1662531115 None] Lock "cinder-fb37cfc6-37e9-43e8-a9ba-45d1089f107f-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Flow 'volume_create_manager' (ab9555d3-1837-4641-bc78-3adcf342d0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e7e12f-e3e5-4b38-a1ac-5b933355989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e7e12f-e3e5-4b38-a1ac-5b933355989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-148091118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50d10f5-e358-4c8c-9ba3-ad16f1b5317c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77172a25b50463d8cd477ca45d737e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:42Z,use_quota=True,user_id='29d0b8da388f4762abf7e3787bd58121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22cf785-f7b9-4bc1-8d28-7acacc51bada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22cf785-f7b9-4bc1-8d28-7acacc51bada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1a8856-39f4-4949-a55b-1c926fa972fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1a8856-39f4-4949-a55b-1c926fa972fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50d10f5-e358-4c8c-9ba3-ad16f1b5317c', 'volume_name': 'volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188d9604-0db9-41cb-ba8a-f08065a0e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188d9604-0db9-41cb-ba8a-f08065a0e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:42 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79610a45-199c-4427-94d4-447b1d428c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:42 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Volume f50d10f5-e358-4c8c-9ba3-ad16f1b5317c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c', 'volume_size': 1} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846" returned: 0 in 0.803s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:42 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 1G Jul 03 14:10:42 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:43 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 1G" returned: 0 in 0.777s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:43 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 Jul 03 14:10:43 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:43 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2" returned: 0 in 0.671s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:43 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 is being set with open permissions: ugo+rw Jul 03 14:10:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:43 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 Jul 03 14:10:43 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:44 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2" returned: 0 in 0.630s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:44 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.info Jul 03 14:10:44 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:45 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.info" returned: 0 in 0.640s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:45 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.info is being set with open permissions: ugo+rw Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:45 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.info Jul 03 14:10:45 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:45 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.info" returned: 0 in 0.647s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.251s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.418s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-148091118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50d10f5-e358-4c8c-9ba3-ad16f1b5317c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77172a25b50463d8cd477ca45d737e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:42Z,use_quota=True,user_id='29d0b8da388f4762abf7e3787bd58121',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Creating volume f50d10f5-e358-4c8c-9ba3-ad16f1b5317c {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:45 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:10:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:45 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c 1073741824 Jul 03 14:10:45 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:46 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f467d80f-15ff-4180-8f36-a5958e7cb02b tempest-ProjectReaderTests-1048536491 None] Create snapshot completed successfully Jul 03 14:10:46 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c 1073741824" returned: 0 in 0.821s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:46 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c Jul 03 14:10:46 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-d1bf74be-eec3-463a-84aa-77569057bbc2-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Lock "cinder-d1bf74be-eec3-463a-84aa-77569057bbc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-f9fd8db1-24d9-42d7-ab17-e62932a00846" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-f9fd8db1-24d9-42d7-ab17-e62932a00846" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-d1bf74be-eec3-463a-84aa-77569057bbc2" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-d1bf74be-eec3-463a-84aa-77569057bbc2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Deleting offline snapshot d1bf74be-eec3-463a-84aa-77569057bbc2 of volume f9fd8db1-24d9-42d7-ab17-e62932a00846 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:10:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] snapshot_file for this snap is: volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:10:46 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aacd8a3-757b-4438-a292-2d05ee69c137]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:47 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 Jul 03 14:10:47 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:47 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c" returned: 0 in 0.631s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79610a45-199c-4427-94d4-447b1d428c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74870aae-71ed-4d10-85d6-a9052509a0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:47 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Volume volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c (f50d10f5-e358-4c8c-9ba3-ad16f1b5317c): created successfully Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74870aae-71ed-4d10-85d6-a9052509a0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Flow 'volume_create_manager' (ab9555d3-1837-4641-bc78-3adcf342d0a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:47 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-10fccdcc-8f3d-4fae-92cc-88fc98bf4e44 tempest-ProjectReaderTests-1662531115 None] Created volume successfully. Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Acquiring lock "cinder-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Lock "cinder-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Acquiring lock "cinder-quobyte-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Lock "cinder-quobyte-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c" acquired by "delete_volume" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:47 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2" returned: 0 in 0.811s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9fd8db1-24d9-42d7-ab17-e62932a00846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[21207039-f2eb-4481-8fc1-7dd68c286622]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e023893-0712-4870-9530-95e327cf2af3]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:47 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c Jul 03 14:10:47 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:47 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 Jul 03 14:10:47 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:48 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846" returned: 0 in 0.736s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:48 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 Jul 03 14:10:48 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:48 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c" returned: 0 in 0.778s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:48 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c Jul 03 14:10:48 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:49 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c" returned: 0 in 0.627s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Lock "cinder-quobyte-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c" released by "delete_volume" :: held 1.456s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:49 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2" returned: 0 in 0.713s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Created reservations ['0f9b5c56-8745-47f6-8dd9-c42e863f89aa', '4ae88563-9bfa-4089-a217-51d0cbfefdae', '2e61d00b-a5c3-4936-8158-546d7350ccaa', 'c8ce084e-ae0d-4d82-add2-443660d72025'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:49 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2 Jul 03 14:10:49 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:49 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:49 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:49 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846.d1bf74be-eec3-463a-84aa-77569057bbc2" returned: 0 in 0.655s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-d1bf74be-eec3-463a-84aa-77569057bbc2" released by "_delete_snapshot" :: held 3.025s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:49 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-f9fd8db1-24d9-42d7-ab17-e62932a00846" released by "delete_snapshot" :: held 3.045s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:50 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.719s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:50 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Deleted volume successfully. Jul 03 14:10:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-d16a1d3a-e4a4-4813-86ca-e08f8887f1e6 tempest-ProjectReaderTests-1662531115 None] Lock "cinder-f50d10f5-e358-4c8c-9ba3-ad16f1b5317c-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:50 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Created reservations ['5e1d514e-e448-4ed3-b6fb-d827c94ac3bc', '3e0d4a57-eeaa-41fb-b6ac-4f2042d99c63', '58b70c14-b6f1-4ea1-abb7-b5110663ac04', '6b971986-8cf5-4f66-a597-9ef522ad141f'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Delete snapshot completed successfully. Jul 03 14:10:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-82de45eb-35ff-4cf8-a9bf-444593d2a0fd tempest-ProjectReaderTests-1048536491 None] Lock "cinder-d1bf74be-eec3-463a-84aa-77569057bbc2-delete_snapshot" released by "delete_snapshot" :: held 3.264s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-f9fd8db1-24d9-42d7-ab17-e62932a00846-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-f9fd8db1-24d9-42d7-ab17-e62932a00846-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-f9fd8db1-24d9-42d7-ab17-e62932a00846" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:10:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-f9fd8db1-24d9-42d7-ab17-e62932a00846" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:10:51 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001b61f-c17f-48fd-9a9a-d08bf22b4ad4]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:51 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 Jul 03 14:10:51 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:52 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846" returned: 0 in 0.756s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:52 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846 Jul 03 14:10:52 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:52 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f9fd8db1-24d9-42d7-ab17-e62932a00846" returned: 0 in 0.631s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:52 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-f9fd8db1-24d9-42d7-ab17-e62932a00846" released by "delete_volume" :: held 1.467s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:52 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Created reservations ['1839646c-0c7b-4ca6-a8ca-e75bf6ab420c', '17bfe9d1-35f4-44d6-9acc-b882d5e177f2', 'b2882cce-6452-4da1-b563-4f83e73bf82f', '7178cf7d-6561-4ecd-ab4c-fb4cbf39f47b'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:10:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:52 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:52 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:52 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:10:52 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:53 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.659s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:10:53 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Deleted volume successfully. Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-f33b0584-5314-414f-bd1e-bd61d7c14839 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-f9fd8db1-24d9-42d7-ab17-e62932a00846-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Flow 'volume_create_manager' (704aa04f-b478-40e9-982b-1f760393e591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0742941-fa48-43bc-8e3a-f005abf4d3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0742941-fa48-43bc-8e3a-f005abf4d3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-31306056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297a44e4-1c0f-4a65-a3df-4eff8587e715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df96c8c56b1e4b48abbee33cccfac7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:54Z,use_quota=True,user_id='252b13c505a241d6a64f1fa7361fa8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f71e9e-b4fd-43a1-ba09-4fa22354879a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f71e9e-b4fd-43a1-ba09-4fa22354879a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01900304-fbf7-47e8-aef5-c1394bbaa065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01900304-fbf7-47e8-aef5-c1394bbaa065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '297a44e4-1c0f-4a65-a3df-4eff8587e715', 'volume_name': 'volume-297a44e4-1c0f-4a65-a3df-4eff8587e715', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478bcd80-a990-4621-8149-5f7ac71879a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478bcd80-a990-4621-8149-5f7ac71879a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b3416c-3937-41d8-8231-14e59ae650bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:53 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Volume 297a44e4-1c0f-4a65-a3df-4eff8587e715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-297a44e4-1c0f-4a65-a3df-4eff8587e715', 'volume_size': 1} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-31306056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297a44e4-1c0f-4a65-a3df-4eff8587e715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df96c8c56b1e4b48abbee33cccfac7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:10:54Z,use_quota=True,user_id='252b13c505a241d6a64f1fa7361fa8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Creating volume 297a44e4-1c0f-4a65-a3df-4eff8587e715 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:10:53 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:10:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:53 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715 1073741824 Jul 03 14:10:53 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:54 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715 1073741824" returned: 0 in 0.766s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:54 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715 Jul 03 14:10:54 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:55 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715" returned: 0 in 0.605s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:10:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:10:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b3416c-3937-41d8-8231-14e59ae650bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-297a44e4-1c0f-4a65-a3df-4eff8587e715', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370ba1ee-f727-485a-81f7-12975dc3af3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:10:55 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Volume volume-297a44e4-1c0f-4a65-a3df-4eff8587e715 (297a44e4-1c0f-4a65-a3df-4eff8587e715): created successfully Jul 03 14:10:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370ba1ee-f727-485a-81f7-12975dc3af3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:10:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Flow 'volume_create_manager' (704aa04f-b478-40e9-982b-1f760393e591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:10:55 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b13a3bc1-818e-4d94-a7b0-519b00121633 tempest-ProjectReaderTests-1048536491 None] Created volume successfully. Jul 03 14:10:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:10:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:10:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] Creating offline snapshot 4da0295f-1c51-4c87-9738-36fe856c5772 of volume 297a44e4-1c0f-4a65-a3df-4eff8587e715 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:10:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb41a2c5-40b4-4bf8-91cc-94843e7b4637]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:10:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:56 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715 Jul 03 14:10:56 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:56 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715" returned: 0 in 0.710s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.4da0295f-1c51-4c87-9738-36fe856c5772 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:56 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.4da0295f-1c51-4c87-9738-36fe856c5772 1G Jul 03 14:10:56 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:57 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.4da0295f-1c51-4c87-9738-36fe856c5772 1G" returned: 0 in 0.762s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-297a44e4-1c0f-4a65-a3df-4eff8587e715 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.4da0295f-1c51-4c87-9738-36fe856c5772 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:57 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-297a44e4-1c0f-4a65-a3df-4eff8587e715 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.4da0295f-1c51-4c87-9738-36fe856c5772 Jul 03 14:10:57 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:58 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-297a44e4-1c0f-4a65-a3df-4eff8587e715 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.4da0295f-1c51-4c87-9738-36fe856c5772" returned: 0 in 0.669s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:58 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.4da0295f-1c51-4c87-9738-36fe856c5772 is being set with open permissions: ugo+rw Jul 03 14:10:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.4da0295f-1c51-4c87-9738-36fe856c5772 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:58 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.4da0295f-1c51-4c87-9738-36fe856c5772 Jul 03 14:10:58 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:58 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.4da0295f-1c51-4c87-9738-36fe856c5772" returned: 0 in 0.607s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:58 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.info Jul 03 14:10:58 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:10:59 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 03 14:10:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.info" returned: 0 in 0.621s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:10:59 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.info is being set with open permissions: ugo+rw Jul 03 14:10:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:10:59 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.info Jul 03 14:10:59 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:00 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-297a44e4-1c0f-4a65-a3df-4eff8587e715.info" returned: 0 in 0.612s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.055s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:11:00 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a060b563-e8c8-48a0-a789-bfb677fd7837 tempest-ProjectReaderTests-1048536491 None] Create snapshot completed successfully Jul 03 14:11:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aaeaf5c7-30ce-47b4-9547-171955bd4cc8 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-4da0295f-1c51-4c87-9738-36fe856c5772-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:11:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aaeaf5c7-30ce-47b4-9547-171955bd4cc8 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-4da0295f-1c51-4c87-9738-36fe856c5772-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:11:01 devstack cinder-volume[86729]: INFO cinder.message.api [None req-aaeaf5c7-30ce-47b4-9547-171955bd4cc8 tempest-ProjectReaderTests-1048536491 None] Creating message record for request_id = req-aaeaf5c7-30ce-47b4-9547-171955bd4cc8 Jul 03 14:11:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aaeaf5c7-30ce-47b4-9547-171955bd4cc8 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-4da0295f-1c51-4c87-9738-36fe856c5772-delete_snapshot" released by "delete_snapshot" :: held 0.032s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server [None req-aaeaf5c7-30ce-47b4-9547-171955bd4cc8 tempest-ProjectReaderTests-1048536491 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 219, in wrapper Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 14:11:01 devstack cinder-volume[86729]: ERROR oslo_messaging.rpc.server Jul 03 14:11:10 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=51,cinder:UPDATE=69,cinder:DELETE=8,cinder:INSERT=19 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:11:11 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=74,cinder:DELETE=6,cinder:SELECT=50,cinder:INSERT=19 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:11:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:11:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:11:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:11:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:11:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:11:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:11:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:11:26 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:11:26 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:11:26 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 03 14:11:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.608s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:11:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:11:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:11:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:12:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:12:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:12:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:12:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:12:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:12:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:12:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:12:26 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:12:26 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:12:26 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jul 03 14:12:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.687s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:12:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:13:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:13:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:13:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:26 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:13:26 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:26 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.614s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:13:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:13:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (c11cb82d-a57c-4929-ba30-aa1a48755584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c115a90-f8ff-4c3e-bbeb-2c556ea72ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c115a90-f8ff-4c3e-bbeb-2c556ea72ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1568424893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6013e197-53fb-4a8e-9147-e6156e9ab4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:13:55Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906f1a4c-00dd-48f7-bbec-414084850078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906f1a4c-00dd-48f7-bbec-414084850078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49ce5f9-8228-4916-8abb-953f53f83531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49ce5f9-8228-4916-8abb-953f53f83531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6013e197-53fb-4a8e-9147-e6156e9ab4e4', 'volume_name': 'volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b21725-8b1e-447d-b18b-149f32e2dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b21725-8b1e-447d-b18b-149f32e2dfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccae8246-e25c-4e01-b2e3-64baf7a2eac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:13:55 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Volume 6013e197-53fb-4a8e-9147-e6156e9ab4e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4', 'volume_size': 1} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1568424893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6013e197-53fb-4a8e-9147-e6156e9ab4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:13:55Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Creating volume 6013e197-53fb-4a8e-9147-e6156e9ab4e4 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:13:55 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:13:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:55 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 1073741824 Jul 03 14:13:55 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:56 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 1073741824" returned: 0 in 0.807s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:56 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 Jul 03 14:13:56 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:56 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4" returned: 0 in 0.644s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:13:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:13:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccae8246-e25c-4e01-b2e3-64baf7a2eac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:13:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545968dc-557c-4b9d-a285-a17207179e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:13:56 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Volume volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 (6013e197-53fb-4a8e-9147-e6156e9ab4e4): created successfully Jul 03 14:13:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545968dc-557c-4b9d-a285-a17207179e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:13:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (c11cb82d-a57c-4929-ba30-aa1a48755584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:13:56 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-f8b5b6c6-665d-4c9d-b85a-3d99a5053d34 tempest-ProjectMemberTests-1023125764 None] Created volume successfully. Jul 03 14:13:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:13:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:13:57 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] Creating offline snapshot b3c412f2-e334-4d88-8d84-5418276b6c81 of volume 6013e197-53fb-4a8e-9147-e6156e9ab4e4 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:13:57 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6a7034-57a1-4003-a9be-b3a1d527fbc9]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:13:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:57 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 Jul 03 14:13:57 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:58 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4" returned: 0 in 0.774s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:58 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 1G Jul 03 14:13:58 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:59 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 1G" returned: 0 in 0.782s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:59 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 Jul 03 14:13:59 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:13:59 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 03 14:13:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81" returned: 0 in 0.674s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:13:59 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 is being set with open permissions: ugo+rw Jul 03 14:13:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:13:59 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 Jul 03 14:13:59 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:00 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81" returned: 0 in 0.626s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:00 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.info Jul 03 14:14:00 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:01 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.info" returned: 0 in 0.646s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:01 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.info is being set with open permissions: ugo+rw Jul 03 14:14:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:01 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.info Jul 03 14:14:01 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:01 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.info" returned: 0 in 0.653s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.235s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:01 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ecb4754a-cbcf-4a6f-81c0-23f9b015e971 tempest-ProjectMemberTests-1023125764 None] Create snapshot completed successfully Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-b3c412f2-e334-4d88-8d84-5418276b6c81-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Lock "cinder-b3c412f2-e334-4d88-8d84-5418276b6c81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-6013e197-53fb-4a8e-9147-e6156e9ab4e4" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-6013e197-53fb-4a8e-9147-e6156e9ab4e4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-b3c412f2-e334-4d88-8d84-5418276b6c81" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-b3c412f2-e334-4d88-8d84-5418276b6c81" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Deleting offline snapshot b3c412f2-e334-4d88-8d84-5418276b6c81 of volume 6013e197-53fb-4a8e-9147-e6156e9ab4e4 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] snapshot_file for this snap is: volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4e9859-3171-4d8c-a7b9-0898a1d05294]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:03 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 Jul 03 14:14:03 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:03 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81" returned: 0 in 0.731s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[82702e47-e1c3-4ba5-bdf1-ad118b3bdb5c]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:04 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 Jul 03 14:14:04 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:04 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4" returned: 0 in 0.745s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:04 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 Jul 03 14:14:04 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:05 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81" returned: 0 in 0.687s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:05 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81 Jul 03 14:14:05 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:05 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4.b3c412f2-e334-4d88-8d84-5418276b6c81" returned: 0 in 0.601s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-b3c412f2-e334-4d88-8d84-5418276b6c81" released by "_delete_snapshot" :: held 2.851s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-6013e197-53fb-4a8e-9147-e6156e9ab4e4" released by "delete_snapshot" :: held 2.872s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:06 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Created reservations ['1545ab74-6cee-4653-8d78-052f411f0ec7', '75d91821-25ab-49a5-a1d6-b115fe2d270f', '98e2a4e0-4318-40b4-b379-b9dd4f550bc2', '13e299b4-52a2-43a5-9c08-0a41a04ce0be'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:06 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Delete snapshot completed successfully. Jul 03 14:14:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-6eac6b08-1581-4668-a309-4071013fe4ca tempest-ProjectMemberTests-1023125764 None] Lock "cinder-b3c412f2-e334-4d88-8d84-5418276b6c81-delete_snapshot" released by "delete_snapshot" :: held 2.997s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-6013e197-53fb-4a8e-9147-e6156e9ab4e4-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Lock "cinder-6013e197-53fb-4a8e-9147-e6156e9ab4e4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-6013e197-53fb-4a8e-9147-e6156e9ab4e4" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-6013e197-53fb-4a8e-9147-e6156e9ab4e4" acquired by "delete_volume" :: waited 0.013s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:06 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aa1f71-11e4-459a-8995-aea060f80240]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:06 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 Jul 03 14:14:06 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:07 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4" returned: 0 in 0.738s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:07 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4 Jul 03 14:14:07 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:07 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-6013e197-53fb-4a8e-9147-e6156e9ab4e4" returned: 0 in 0.644s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:07 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-6013e197-53fb-4a8e-9147-e6156e9ab4e4" released by "delete_volume" :: held 1.434s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:07 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Created reservations ['ef613503-a08a-4523-9760-1724447afc80', '2ecffdf2-131c-4e6b-851e-94b483facd58', 'c2698ed5-826d-4a76-af92-5992ff3b3560', '776585a6-cc69-4699-a718-799bf1835e9b'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:07 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:07 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:14:07 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:08 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.626s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:14:08 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Deleted volume successfully. Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-41a18778-d2b2-447f-a7b0-f7da8653c4fc tempest-ProjectMemberTests-1023125764 None] Lock "cinder-6013e197-53fb-4a8e-9147-e6156e9ab4e4-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (cae17d6f-aaa4-4bff-b96a-fb5bb2829c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1002906-a7e9-4159-ac0a-c892bdf3c848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1002906-a7e9-4159-ac0a-c892bdf3c848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313992472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e2ec61-e70c-4895-bc97-474025f01602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:09Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25282460-8272-49a5-aa24-0dc6860c62b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25282460-8272-49a5-aa24-0dc6860c62b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a94c90-07dc-4c3b-b84c-1410c33c64fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a94c90-07dc-4c3b-b84c-1410c33c64fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e2ec61-e70c-4895-bc97-474025f01602', 'volume_name': 'volume-45e2ec61-e70c-4895-bc97-474025f01602', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b132a6a-1f1a-4188-877b-efab539d489a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b132a6a-1f1a-4188-877b-efab539d489a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4baf9ca2-c4fc-49b7-a928-48e9cc63cebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:08 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Volume 45e2ec61-e70c-4895-bc97-474025f01602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e2ec61-e70c-4895-bc97-474025f01602', 'volume_size': 1} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313992472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e2ec61-e70c-4895-bc97-474025f01602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:09Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Creating volume 45e2ec61-e70c-4895-bc97-474025f01602 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:09 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:14:09 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:14:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:09 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 1073741824 Jul 03 14:14:09 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:09 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 1073741824" returned: 0 in 0.764s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:09 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:09 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 Jul 03 14:14:09 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:10 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602" returned: 0 in 0.607s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:10 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:14:10 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4baf9ca2-c4fc-49b7-a928-48e9cc63cebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e2ec61-e70c-4895-bc97-474025f01602', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de22e74-147b-4d67-addd-9f61f102458f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:10 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Volume volume-45e2ec61-e70c-4895-bc97-474025f01602 (45e2ec61-e70c-4895-bc97-474025f01602): created successfully Jul 03 14:14:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de22e74-147b-4d67-addd-9f61f102458f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:10 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (cae17d6f-aaa4-4bff-b96a-fb5bb2829c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:10 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-bb96df1d-d118-4790-b0ea-7b47b949ec81 tempest-ProjectMemberTests-1023125764 None] Created volume successfully. Jul 03 14:14:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:11 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] Creating offline snapshot 8bad8a7e-b9da-4cf7-97db-3315359be96a of volume 45e2ec61-e70c-4895-bc97-474025f01602 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:14:11 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfa1c07-761e-4852-aa51-1990fb89578f]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:11 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 Jul 03 14:14:11 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:11 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602" returned: 0 in 0.758s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:11 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:11 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a 1G Jul 03 14:14:11 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:12 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a 1G" returned: 0 in 0.769s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:12 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e2ec61-e70c-4895-bc97-474025f01602 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:12 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e2ec61-e70c-4895-bc97-474025f01602 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a Jul 03 14:14:12 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:13 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e2ec61-e70c-4895-bc97-474025f01602 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a" returned: 0 in 0.646s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:13 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a is being set with open permissions: ugo+rw Jul 03 14:14:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:13 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a Jul 03 14:14:13 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:13 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a" returned: 0 in 0.602s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:13 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:13 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.info Jul 03 14:14:13 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:14 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.info" returned: 0 in 0.626s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:14 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.info is being set with open permissions: ugo+rw Jul 03 14:14:14 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:14 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.info Jul 03 14:14:14 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:15 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.info" returned: 0 in 0.605s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:15 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.087s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:15 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ebf27d03-92dc-4fdb-9d7b-5be2a0491c25 tempest-ProjectMemberTests-1023125764 None] Create snapshot completed successfully Jul 03 14:14:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-8bad8a7e-b9da-4cf7-97db-3315359be96a-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-8bad8a7e-b9da-4cf7-97db-3315359be96a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-45e2ec61-e70c-4895-bc97-474025f01602" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-45e2ec61-e70c-4895-bc97-474025f01602" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-8bad8a7e-b9da-4cf7-97db-3315359be96a" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:16 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-8bad8a7e-b9da-4cf7-97db-3315359be96a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Deleting offline snapshot 8bad8a7e-b9da-4cf7-97db-3315359be96a of volume 45e2ec61-e70c-4895-bc97-474025f01602 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:14:16 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] snapshot_file for this snap is: volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:14:16 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9b9028-bed5-49a4-a434-246ab25ff9f2]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:16 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:16 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a Jul 03 14:14:16 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:17 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a" returned: 0 in 0.718s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:17 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45e2ec61-e70c-4895-bc97-474025f01602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:14:17 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c235343-a749-41df-acb9-7187d0d616ad]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:17 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:17 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 Jul 03 14:14:17 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:14:18 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Flow 'volume_create_manager' (05de18ac-4f48-42a6-921d-c53788af7b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587f6d95-1633-4f52-b4fc-1c81f900adee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602" returned: 0 in 0.840s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:18 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a Jul 03 14:14:18 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587f6d95-1633-4f52-b4fc-1c81f900adee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172949335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42fbff5-2162-4d2f-a193-cf0c6b8d2534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df96c8c56b1e4b48abbee33cccfac7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:18Z,use_quota=True,user_id='252b13c505a241d6a64f1fa7361fa8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105c9c37-5423-4db7-bfe5-2a23cb4a700c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105c9c37-5423-4db7-bfe5-2a23cb4a700c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a6d3ed-d9ed-4287-af7a-3c6cab178651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a6d3ed-d9ed-4287-af7a-3c6cab178651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f42fbff5-2162-4d2f-a193-cf0c6b8d2534', 'volume_name': 'volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bebac00-11ab-480e-a8a9-d1a37e26d81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bebac00-11ab-480e-a8a9-d1a37e26d81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4198e4-94d7-4f7c-9855-ee909193caf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:18 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Volume f42fbff5-2162-4d2f-a193-cf0c6b8d2534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534', 'volume_size': 1} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1172949335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42fbff5-2162-4d2f-a193-cf0c6b8d2534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df96c8c56b1e4b48abbee33cccfac7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:18Z,use_quota=True,user_id='252b13c505a241d6a64f1fa7361fa8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Creating volume f42fbff5-2162-4d2f-a193-cf0c6b8d2534 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:14:18 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:18 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 1073741824 Jul 03 14:14:18 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:18 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a" returned: 0 in 0.750s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:18 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:18 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a Jul 03 14:14:18 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:19 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 1073741824" returned: 0 in 0.829s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:19 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 Jul 03 14:14:19 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:19 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602.8bad8a7e-b9da-4cf7-97db-3315359be96a" returned: 0 in 0.671s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-8bad8a7e-b9da-4cf7-97db-3315359be96a" released by "_delete_snapshot" :: held 3.087s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-45e2ec61-e70c-4895-bc97-474025f01602" released by "delete_snapshot" :: held 3.110s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Created reservations ['f46cf8b2-d3a7-455a-8d38-bdfac76599a2', '1aefc40b-36c6-4e70-94ed-02b5ee729ad7', '2c3ecf94-09cf-4ae4-9b11-76b94b3700ac', '9f96c54c-9892-4b16-a518-58a3db4c07bc'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:19 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534" returned: 0 in 0.622s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4198e4-94d7-4f7c-9855-ee909193caf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e6ef9a-6449-45ed-ac25-fa649433f729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:19 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Volume volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 (f42fbff5-2162-4d2f-a193-cf0c6b8d2534): created successfully Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e6ef9a-6449-45ed-ac25-fa649433f729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Flow 'volume_create_manager' (05de18ac-4f48-42a6-921d-c53788af7b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:19 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-94776cfc-f504-4f2b-9182-1feadef96c0a tempest-ProjectReaderTests-1048536491 None] Created volume successfully. Jul 03 14:14:19 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Delete snapshot completed successfully. Jul 03 14:14:19 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-29d22c6e-bc37-41fe-ba91-29d395eb5376 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-8bad8a7e-b9da-4cf7-97db-3315359be96a-delete_snapshot" released by "delete_snapshot" :: held 3.305s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:20 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] Creating offline snapshot b1287090-9770-484f-a9f2-8507601fe187 of volume f42fbff5-2162-4d2f-a193-cf0c6b8d2534 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:14:20 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5fafda-679b-4ca8-87d2-369231f15d77]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:20 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 Jul 03 14:14:20 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-45e2ec61-e70c-4895-bc97-474025f01602-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Lock "cinder-45e2ec61-e70c-4895-bc97-474025f01602-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-45e2ec61-e70c-4895-bc97-474025f01602" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:20 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-45e2ec61-e70c-4895-bc97-474025f01602" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:20 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fcf382-9555-4d19-8f06-279a29d32a4b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:20 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:20 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 Jul 03 14:14:20 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:21 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534" returned: 0 in 0.760s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:21 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 1G Jul 03 14:14:21 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:21 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602" returned: 0 in 0.772s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:21 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602 Jul 03 14:14:21 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:21 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 1G" returned: 0 in 0.825s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:21 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:21 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 Jul 03 14:14:21 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:22 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-45e2ec61-e70c-4895-bc97-474025f01602" returned: 0 in 0.619s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:22 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-45e2ec61-e70c-4895-bc97-474025f01602" released by "delete_volume" :: held 1.456s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:22 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Created reservations ['e49261a3-5659-4d1c-a5c5-eca3017f979a', '34baec76-7571-405e-af41-79d5eb147132', 'f695eb33-3cc7-46dc-89ee-bdd40424d509', '37402047-7f51-45d6-9a93-c7528012b1d4'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:22 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:22 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:14:22 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:22 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187" returned: 0 in 0.708s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:22 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 is being set with open permissions: ugo+rw Jul 03 14:14:22 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:22 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 Jul 03 14:14:22 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:23 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.678s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:14:23 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Deleted volume successfully. Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-c6e6179d-086b-4849-9d70-daa6a401dd4c tempest-ProjectMemberTests-1023125764 None] Lock "cinder-45e2ec61-e70c-4895-bc97-474025f01602-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:23 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187" returned: 0 in 0.627s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:23 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.info Jul 03 14:14:23 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (6006361f-510c-4e63-a4a6-7f0e652003f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23548a7a-cb94-4694-8ed3-a7bb7fae550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23548a7a-cb94-4694-8ed3-a7bb7fae550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-513718166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fadbdaf-9f89-46cb-8c10-3c249d53deff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:23Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be143370-64f2-402d-8e17-f9eb6e963a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be143370-64f2-402d-8e17-f9eb6e963a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6098386-e73f-4710-93d0-fba776109cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6098386-e73f-4710-93d0-fba776109cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fadbdaf-9f89-46cb-8c10-3c249d53deff', 'volume_name': 'volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4af91de-fbf3-4fd9-ba6e-9f1b62213764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4af91de-fbf3-4fd9-ba6e-9f1b62213764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa41b454-a2d7-478d-becf-68855bcf024f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:23 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Volume 8fadbdaf-9f89-46cb-8c10-3c249d53deff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff', 'volume_size': 1} Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:23 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.info" returned: 0 in 0.632s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:23 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.info is being set with open permissions: ugo+rw Jul 03 14:14:23 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:23 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.info Jul 03 14:14:23 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:24 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.info" returned: 0 in 0.639s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.265s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.110s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-513718166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fadbdaf-9f89-46cb-8c10-3c249d53deff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:23Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:14:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Creating volume 8fadbdaf-9f89-46cb-8c10-3c249d53deff {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:14:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:24 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:14:24 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:14:24 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:24 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff 1073741824 Jul 03 14:14:24 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:24 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d35d8f70-3494-4413-8adc-c53174e081d1 tempest-ProjectReaderTests-1048536491 None] Create snapshot completed successfully Jul 03 14:14:25 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff 1073741824" returned: 0 in 0.785s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:25 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff Jul 03 14:14:25 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-b1287090-9770-484f-a9f2-8507601fe187-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-b1287090-9770-484f-a9f2-8507601fe187-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-f42fbff5-2162-4d2f-a193-cf0c6b8d2534" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-f42fbff5-2162-4d2f-a193-cf0c6b8d2534" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-b1287090-9770-484f-a9f2-8507601fe187" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:25 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-b1287090-9770-484f-a9f2-8507601fe187" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Deleting offline snapshot b1287090-9770-484f-a9f2-8507601fe187 of volume f42fbff5-2162-4d2f-a193-cf0c6b8d2534 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:14:25 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] snapshot_file for this snap is: volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:14:25 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba6f7cf-fb84-4692-a62d-c4add6c322ee]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:25 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:25 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 Jul 03 14:14:25 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:26 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:14:26 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:26 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff" returned: 0 in 0.657s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa41b454-a2d7-478d-becf-68855bcf024f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2bd220-f00c-4438-b07c-f41f6817c26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:26 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Volume volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff (8fadbdaf-9f89-46cb-8c10-3c249d53deff): created successfully Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2bd220-f00c-4438-b07c-f41f6817c26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (6006361f-510c-4e63-a4a6-7f0e652003f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:26 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-1d73995c-e380-4049-b619-707de75d4791 tempest-ProjectMemberTests-1023125764 None] Created volume successfully. Jul 03 14:14:26 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187" returned: 0 in 0.769s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fcd0fb-44a8-40bd-a2a7-e670e4f188b0]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:26 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 Jul 03 14:14:26 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] Creating offline snapshot c2d82a44-5ad0-4a71-a049-a618060606ac of volume 8fadbdaf-9f89-46cb-8c10-3c249d53deff {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[e766d7b1-63ec-4f72-8a8b-2ee7cca950f7]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:26 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.776s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:14:26 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff Jul 03 14:14:26 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:27 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534" returned: 0 in 0.823s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:27 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 Jul 03 14:14:27 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:27 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff" returned: 0 in 0.742s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:27 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:27 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac 1G Jul 03 14:14:27 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:28 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187" returned: 0 in 0.763s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:28 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187 Jul 03 14:14:28 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:28 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac 1G" returned: 0 in 0.801s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:28 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac Jul 03 14:14:28 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:28 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:28 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534.b1287090-9770-484f-a9f2-8507601fe187" returned: 0 in 0.671s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-b1287090-9770-484f-a9f2-8507601fe187" released by "_delete_snapshot" :: held 3.147s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-f42fbff5-2162-4d2f-a193-cf0c6b8d2534" released by "delete_snapshot" :: held 3.169s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:28 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Created reservations ['221d44d4-1b9a-481c-a115-5028643e88d7', '5d3da932-1f2b-42ab-8c14-28b6cb861821', 'dd1982b2-9c41-4166-9357-5becd2ea5829', '5df22ddc-4773-451b-a688-110ece67271d'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:28 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Delete snapshot completed successfully. Jul 03 14:14:28 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-81788c12-b933-4a80-89e8-2db3f4b4ab89 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-b1287090-9770-484f-a9f2-8507601fe187-delete_snapshot" released by "delete_snapshot" :: held 3.312s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:29 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac" returned: 0 in 0.743s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:29 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac is being set with open permissions: ugo+rw Jul 03 14:14:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:29 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac Jul 03 14:14:29 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:29 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac" returned: 0 in 0.644s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:29 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.info Jul 03 14:14:29 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-f42fbff5-2162-4d2f-a193-cf0c6b8d2534-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-f42fbff5-2162-4d2f-a193-cf0c6b8d2534-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-f42fbff5-2162-4d2f-a193-cf0c6b8d2534" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:29 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-f42fbff5-2162-4d2f-a193-cf0c6b8d2534" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:29 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[c235146a-d27c-4b02-93d5-3d12948e1ebd]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:29 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:30 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 Jul 03 14:14:30 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:30 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.info" returned: 0 in 0.680s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:30 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.info is being set with open permissions: ugo+rw Jul 03 14:14:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:30 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.info Jul 03 14:14:30 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:30 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534" returned: 0 in 0.775s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:30 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:30 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534 Jul 03 14:14:30 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:31 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.info" returned: 0 in 0.691s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.398s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:31 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-27541ba7-52b2-4a07-8549-22ca82b7521e tempest-ProjectMemberTests-1023125764 None] Create snapshot completed successfully Jul 03 14:14:31 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-f42fbff5-2162-4d2f-a193-cf0c6b8d2534" returned: 0 in 0.646s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:31 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-f42fbff5-2162-4d2f-a193-cf0c6b8d2534" released by "delete_volume" :: held 1.476s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:31 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Created reservations ['e592faf2-4152-422e-bc1a-c675e108469b', 'dd9165ba-1bcd-497b-922e-d07ffa2cba55', 'ddcf740c-a6bd-4f3c-a7f3-775cfd6f4f3f', 'e13f3db8-c11d-44e3-92c6-9e98bcd7afed'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:31 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:31 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:31 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:14:31 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-c2d82a44-5ad0-4a71-a049-a618060606ac-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-c2d82a44-5ad0-4a71-a049-a618060606ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-8fadbdaf-9f89-46cb-8c10-3c249d53deff" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-8fadbdaf-9f89-46cb-8c10-3c249d53deff" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-c2d82a44-5ad0-4a71-a049-a618060606ac" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-c2d82a44-5ad0-4a71-a049-a618060606ac" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Deleting offline snapshot c2d82a44-5ad0-4a71-a049-a618060606ac of volume 8fadbdaf-9f89-46cb-8c10-3c249d53deff {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] snapshot_file for this snap is: volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:14:32 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.639s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dd2e50-04c4-49ea-8b39-26c85868387a]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:32 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Deleted volume successfully. Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b707941a-3dfa-4ca5-84be-8bc1b4fd26e0 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-f42fbff5-2162-4d2f-a193-cf0c6b8d2534-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:32 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac Jul 03 14:14:32 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Flow 'volume_create_manager' (9ee7a6c2-2724-49df-91ca-5a9d11e16f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2957d8-f1da-4d8a-a6b0-eb40ccba332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2957d8-f1da-4d8a-a6b0-eb40ccba332a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335849241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190bc9fa-7265-4794-bd56-e8c0e81a68fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df96c8c56b1e4b48abbee33cccfac7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:33Z,use_quota=True,user_id='252b13c505a241d6a64f1fa7361fa8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fc3b0d-329b-442f-9836-87de9e6a8b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fc3b0d-329b-442f-9836-87de9e6a8b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09daf745-13cf-447a-a77e-71694610217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09daf745-13cf-447a-a77e-71694610217d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '190bc9fa-7265-4794-bd56-e8c0e81a68fc', 'volume_name': 'volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa42760-4e92-4e94-b14a-b137e2549b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa42760-4e92-4e94-b14a-b137e2549b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aab440c-11eb-4a3e-85b8-f79ecdf37e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:32 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Volume 190bc9fa-7265-4794-bd56-e8c0e81a68fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc', 'volume_size': 1} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335849241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190bc9fa-7265-4794-bd56-e8c0e81a68fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df96c8c56b1e4b48abbee33cccfac7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:33Z,use_quota=True,user_id='252b13c505a241d6a64f1fa7361fa8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Creating volume 190bc9fa-7265-4794-bd56-e8c0e81a68fc {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:14:32 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:32 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc 1073741824 Jul 03 14:14:32 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:32 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac" returned: 0 in 0.782s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[72244b3c-a382-4c14-92c6-874b6e94c7b0]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:32 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:33 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff Jul 03 14:14:33 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:33 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc 1073741824" returned: 0 in 0.861s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:33 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc Jul 03 14:14:33 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:33 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff" returned: 0 in 0.841s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:33 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:33 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac Jul 03 14:14:33 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:34 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc" returned: 0 in 0.636s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aab440c-11eb-4a3e-85b8-f79ecdf37e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372da01a-c260-43f3-9a84-7ee813b36f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:34 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Volume volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc (190bc9fa-7265-4794-bd56-e8c0e81a68fc): created successfully Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372da01a-c260-43f3-9a84-7ee813b36f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Flow 'volume_create_manager' (9ee7a6c2-2724-49df-91ca-5a9d11e16f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:34 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-c908b941-b5d0-4cd9-bf4e-24b96bd7755e tempest-ProjectReaderTests-1048536491 None] Created volume successfully. Jul 03 14:14:34 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac" returned: 0 in 0.728s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:34 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac Jul 03 14:14:34 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] Creating offline snapshot ec57647a-e032-46d4-abab-8c5d00a1849f of volume 190bc9fa-7265-4794-bd56-e8c0e81a68fc {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[df420ba1-87ec-44d8-8ed4-3a952831aedf]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:34 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:34 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc Jul 03 14:14:34 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:35 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff.c2d82a44-5ad0-4a71-a049-a618060606ac" returned: 0 in 0.653s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-c2d82a44-5ad0-4a71-a049-a618060606ac" released by "_delete_snapshot" :: held 3.125s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-8fadbdaf-9f89-46cb-8c10-3c249d53deff" released by "delete_snapshot" :: held 3.153s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:35 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Created reservations ['28ced8a7-8744-446d-9776-560011151168', '82ab7493-ea17-4d2d-8cb8-81c009fdf5d6', '0d5f32d3-2dd9-461d-8988-80f18c277fa6', 'fa3fbade-ccff-45a8-a30a-484e7ecc6359'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:35 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Delete snapshot completed successfully. Jul 03 14:14:35 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3d3558df-ea31-4152-8318-e4df1ff64e51 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-c2d82a44-5ad0-4a71-a049-a618060606ac-delete_snapshot" released by "delete_snapshot" :: held 3.313s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:35 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc" returned: 0 in 0.744s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:35 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:35 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f 1G Jul 03 14:14:35 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-8fadbdaf-9f89-46cb-8c10-3c249d53deff-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-8fadbdaf-9f89-46cb-8c10-3c249d53deff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-8fadbdaf-9f89-46cb-8c10-3c249d53deff" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:36 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-8fadbdaf-9f89-46cb-8c10-3c249d53deff" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:36 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c40cbb1-c7b9-4cf8-8cae-65413dfa5f91]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:36 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f 1G" returned: 0 in 0.831s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:36 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:36 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f Jul 03 14:14:36 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:36 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff Jul 03 14:14:36 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:37 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff" returned: 0 in 0.755s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:37 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff Jul 03 14:14:37 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:37 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f" returned: 0 in 0.697s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:37 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f is being set with open permissions: ugo+rw Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:37 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f Jul 03 14:14:37 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:37 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-8fadbdaf-9f89-46cb-8c10-3c249d53deff" returned: 0 in 0.675s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:37 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f" returned: 0 in 0.661s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-8fadbdaf-9f89-46cb-8c10-3c249d53deff" released by "delete_volume" :: held 1.493s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:37 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.info Jul 03 14:14:37 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Created reservations ['d49d00e5-5521-4007-b7ce-f9fbafdc63a5', 'ab6d61a1-6062-4741-9c09-b145e54ec042', '13818b34-d40c-40ab-85d5-0c6270580aeb', 'ee577017-c194-47d6-b10f-7240544f2a89'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:37 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:38 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:14:38 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:38 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.info" returned: 0 in 0.831s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:38 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.info is being set with open permissions: ugo+rw Jul 03 14:14:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:38 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.info Jul 03 14:14:38 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:38 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:38 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.728s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:38 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:14:38 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Deleted volume successfully. Jul 03 14:14:38 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3b753f8a-e5bd-4668-b3b0-acc58a3db115 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-8fadbdaf-9f89-46cb-8c10-3c249d53deff-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:38 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:14:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (0bfc1c82-9091-45e9-b668-e7834c5bea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69692f8-6861-44db-895f-6c50848f15e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69692f8-6861-44db-895f-6c50848f15e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878767230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4022606-305e-4fa1-9383-6a252adf75ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:39Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f37298-d2e5-441c-aaee-e1c44e678a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f37298-d2e5-441c-aaee-e1c44e678a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b194dd85-0a43-495d-a76e-20f8667b112e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b194dd85-0a43-495d-a76e-20f8667b112e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4022606-305e-4fa1-9383-6a252adf75ea', 'volume_name': 'volume-a4022606-305e-4fa1-9383-6a252adf75ea', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3def6b5e-5d76-4f5e-81cf-1361a9dc2fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3def6b5e-5d76-4f5e-81cf-1361a9dc2fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0897af70-cb7a-4620-9bbc-514cbf0783bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:39 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Volume a4022606-305e-4fa1-9383-6a252adf75ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4022606-305e-4fa1-9383-6a252adf75ea', 'volume_size': 1} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:39 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.info" returned: 0 in 0.713s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.572s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878767230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4022606-305e-4fa1-9383-6a252adf75ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:39Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Creating volume a4022606-305e-4fa1-9383-6a252adf75ea {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:14:39 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:14:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:39 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea 1073741824 Jul 03 14:14:39 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:39 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-ccdeb5dd-10c3-4db8-98c2-146e900592d3 tempest-ProjectReaderTests-1048536491 None] Create snapshot completed successfully Jul 03 14:14:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-ec57647a-e032-46d4-abab-8c5d00a1849f-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-ec57647a-e032-46d4-abab-8c5d00a1849f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-190bc9fa-7265-4794-bd56-e8c0e81a68fc" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-190bc9fa-7265-4794-bd56-e8c0e81a68fc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-ec57647a-e032-46d4-abab-8c5d00a1849f" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:40 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-ec57647a-e032-46d4-abab-8c5d00a1849f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Deleting offline snapshot ec57647a-e032-46d4-abab-8c5d00a1849f of volume 190bc9fa-7265-4794-bd56-e8c0e81a68fc {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:14:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] snapshot_file for this snap is: volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:14:40 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a31c2aa-e18e-494d-9b23-6d90ad450509]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:40 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f Jul 03 14:14:40 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:40 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea 1073741824" returned: 0 in 0.911s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:40 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea Jul 03 14:14:40 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:41 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea" returned: 0 in 0.646s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0897af70-cb7a-4620-9bbc-514cbf0783bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4022606-305e-4fa1-9383-6a252adf75ea', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3ddefe-f572-44bb-b779-0b09f1529941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:41 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Volume volume-a4022606-305e-4fa1-9383-6a252adf75ea (a4022606-305e-4fa1-9383-6a252adf75ea): created successfully Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3ddefe-f572-44bb-b779-0b09f1529941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (0bfc1c82-9091-45e9-b668-e7834c5bea91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:41 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f" returned: 0 in 0.888s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:14:41 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-d3f9cd98-f882-4a0a-81eb-39a4e2cd81c1 tempest-ProjectMemberTests-1023125764 None] Created volume successfully. Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5a8409-aa61-4995-a3f1-e533e28a6b07]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:41 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc Jul 03 14:14:41 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:41 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc" returned: 0 in 0.791s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:41 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f Jul 03 14:14:41 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:42 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] Creating offline snapshot c2eef928-769d-48d0-812f-9f8668a4e732 of volume a4022606-305e-4fa1-9383-6a252adf75ea {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:14:42 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bcd461-b4ce-4e62-b840-47f68a642dca]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:42 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea Jul 03 14:14:42 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:42 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f" returned: 0 in 0.790s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:42 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f Jul 03 14:14:42 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:43 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea" returned: 0 in 0.884s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:43 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 1G Jul 03 14:14:43 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:43 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc.ec57647a-e032-46d4-abab-8c5d00a1849f" returned: 0 in 0.739s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:43 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-ec57647a-e032-46d4-abab-8c5d00a1849f" released by "_delete_snapshot" :: held 3.313s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:43 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-190bc9fa-7265-4794-bd56-e8c0e81a68fc" released by "delete_snapshot" :: held 3.342s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:43 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Created reservations ['83a57c48-79fe-489c-8335-5e8bb3536e01', '838dbd42-426e-4b82-8b47-4876f5b7f321', 'c365d84c-ce4b-4892-8f9e-13bd4a855814', '2fca928c-e24f-406e-b5c5-d42d03343815'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:43 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Delete snapshot completed successfully. Jul 03 14:14:43 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-85f24cd1-a963-4974-8cd9-cf0cf6c590b7 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-ec57647a-e032-46d4-abab-8c5d00a1849f-delete_snapshot" released by "delete_snapshot" :: held 3.500s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:44 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 1G" returned: 0 in 0.810s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4022606-305e-4fa1-9383-6a252adf75ea -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:44 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4022606-305e-4fa1-9383-6a252adf75ea -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 Jul 03 14:14:44 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-190bc9fa-7265-4794-bd56-e8c0e81a68fc-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Lock "cinder-190bc9fa-7265-4794-bd56-e8c0e81a68fc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-190bc9fa-7265-4794-bd56-e8c0e81a68fc" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:44 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-190bc9fa-7265-4794-bd56-e8c0e81a68fc" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:44 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb3daf-4979-4584-8bdf-3ec3c2d5bfab]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:44 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc Jul 03 14:14:44 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:44 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4022606-305e-4fa1-9383-6a252adf75ea -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732" returned: 0 in 0.755s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:44 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 is being set with open permissions: ugo+rw Jul 03 14:14:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:44 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 Jul 03 14:14:44 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:45 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc" returned: 0 in 0.747s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:45 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc Jul 03 14:14:45 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:45 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732" returned: 0 in 0.694s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:45 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.info Jul 03 14:14:45 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:45 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-190bc9fa-7265-4794-bd56-e8c0e81a68fc" returned: 0 in 0.633s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:45 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-190bc9fa-7265-4794-bd56-e8c0e81a68fc" released by "delete_volume" :: held 1.451s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:45 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=79,cinder:UPDATE=85,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:14:45 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Created reservations ['87149721-9b97-4a48-80cd-0c8dc0dde860', '4a0a36bb-9458-42b6-b662-38a60b82179d', 'd993940c-860b-4f9b-8ac8-c36af3edbea3', 'aaaa20be-fb96-408d-853e-5c6976379e9a'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:46 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:14:46 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:46 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.info" returned: 0 in 0.707s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:46 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.info is being set with open permissions: ugo+rw Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:46 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.info Jul 03 14:14:46 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:46 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.672s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:14:46 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Deleted volume successfully. Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b7cdf955-20af-4e3c-8010-2d354bb3538c tempest-ProjectReaderTests-1048536491 None] Lock "cinder-190bc9fa-7265-4794-bd56-e8c0e81a68fc-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:46 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.info" returned: 0 in 0.689s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:46 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.652s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:46 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-8b53c0c5-0289-4d81-83f1-a650145747c7 tempest-ProjectMemberTests-1023125764 None] Create snapshot completed successfully Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Flow 'volume_create_manager' (b640e6a7-5860-40e6-b8a4-5ed16932f6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b302c6-5bc5-4d68-b8c9-7013b576191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b302c6-5bc5-4d68-b8c9-7013b576191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317836233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e179a32-a8d0-4cde-a125-d1d6c325e9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df96c8c56b1e4b48abbee33cccfac7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:47Z,use_quota=True,user_id='252b13c505a241d6a64f1fa7361fa8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc323f2a-2ee6-418c-beb5-63d4f786e9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc323f2a-2ee6-418c-beb5-63d4f786e9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f073a876-aab4-4c6d-99b4-ec979c69787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f073a876-aab4-4c6d-99b4-ec979c69787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e179a32-a8d0-4cde-a125-d1d6c325e9e6', 'volume_name': 'volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8183bce9-749b-4cd4-931b-51ab4bd1a8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8183bce9-749b-4cd4-931b-51ab4bd1a8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4d5ec3-094a-4a1e-af8c-63b23629f66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:47 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Volume 4e179a32-a8d0-4cde-a125-d1d6c325e9e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6', 'volume_size': 1} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317836233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e179a32-a8d0-4cde-a125-d1d6c325e9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df96c8c56b1e4b48abbee33cccfac7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:47Z,use_quota=True,user_id='252b13c505a241d6a64f1fa7361fa8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Creating volume 4e179a32-a8d0-4cde-a125-d1d6c325e9e6 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:14:47 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:47 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 1073741824 Jul 03 14:14:47 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-c2eef928-769d-48d0-812f-9f8668a4e732-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Lock "cinder-c2eef928-769d-48d0-812f-9f8668a4e732-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-a4022606-305e-4fa1-9383-6a252adf75ea" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-a4022606-305e-4fa1-9383-6a252adf75ea" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-c2eef928-769d-48d0-812f-9f8668a4e732" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-c2eef928-769d-48d0-812f-9f8668a4e732" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Deleting offline snapshot c2eef928-769d-48d0-812f-9f8668a4e732 of volume a4022606-305e-4fa1-9383-6a252adf75ea {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] snapshot_file for this snap is: volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f499f4fd-8db0-4bb9-a87a-4ca2048ac3f5]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:47 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 Jul 03 14:14:47 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:48 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 1073741824" returned: 0 in 0.886s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:48 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 Jul 03 14:14:48 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:48 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732" returned: 0 in 0.759s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4022606-305e-4fa1-9383-6a252adf75ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2865a4-bdfd-4348-b72a-ca1d036a14a9]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:48 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea Jul 03 14:14:48 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:48 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6" returned: 0 in 0.672s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4d5ec3-094a-4a1e-af8c-63b23629f66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802d7896-c601-4fac-8395-0c8db906edf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:48 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Volume volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 (4e179a32-a8d0-4cde-a125-d1d6c325e9e6): created successfully Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802d7896-c601-4fac-8395-0c8db906edf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:48 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Flow 'volume_create_manager' (b640e6a7-5860-40e6-b8a4-5ed16932f6de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:48 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-2b023221-180e-4dde-aff2-08e1348e5a31 tempest-ProjectReaderTests-1048536491 None] Created volume successfully. Jul 03 14:14:49 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea" returned: 0 in 0.816s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:49 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 Jul 03 14:14:49 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:49 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] Creating offline snapshot 9a2fce12-4412-4544-b793-6cae7f63c1b9 of volume 4e179a32-a8d0-4cde-a125-d1d6c325e9e6 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:14:49 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9ad75d-3a4e-44cb-b150-53c957454ca9]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:49 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:49 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 Jul 03 14:14:49 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:50 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732" returned: 0 in 0.747s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:50 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732 Jul 03 14:14:50 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:50 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6" returned: 0 in 0.774s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:50 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 1G Jul 03 14:14:50 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:50 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:50 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea.c2eef928-769d-48d0-812f-9f8668a4e732" returned: 0 in 0.717s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-c2eef928-769d-48d0-812f-9f8668a4e732" released by "_delete_snapshot" :: held 3.145s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-a4022606-305e-4fa1-9383-6a252adf75ea" released by "delete_snapshot" :: held 3.172s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:50 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Created reservations ['a7f026de-43ba-4db0-b17a-229f5b90b4ff', 'c28e9719-d1d5-4da5-a8f7-a63db0f068c7', '268d27d1-5c32-4f45-8b31-9286449f6e23', '254e0760-aee9-4fac-999e-ade193f03bec'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:50 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Delete snapshot completed successfully. Jul 03 14:14:50 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-aaa5ea40-ceef-45a8-a222-b6f705d9f1aa tempest-ProjectMemberTests-1023125764 None] Lock "cinder-c2eef928-769d-48d0-812f-9f8668a4e732-delete_snapshot" released by "delete_snapshot" :: held 3.330s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:51 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 1G" returned: 0 in 0.897s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:51 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 Jul 03 14:14:51 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:51 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9" returned: 0 in 0.739s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:51 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 is being set with open permissions: ugo+rw Jul 03 14:14:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-a4022606-305e-4fa1-9383-6a252adf75ea-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:51 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 Jul 03 14:14:51 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Lock "cinder-a4022606-305e-4fa1-9383-6a252adf75ea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-a4022606-305e-4fa1-9383-6a252adf75ea" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:51 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-a4022606-305e-4fa1-9383-6a252adf75ea" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:51 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[69464712-a925-49b0-a053-2aaf5868dec7]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:51 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:52 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea Jul 03 14:14:52 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:52 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9" returned: 0 in 0.681s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:52 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.info Jul 03 14:14:52 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:52 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea" returned: 0 in 0.833s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:52 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:52 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea Jul 03 14:14:52 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:53 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.info" returned: 0 in 0.633s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:53 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.info is being set with open permissions: ugo+rw Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:53 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.info Jul 03 14:14:53 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:53 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-a4022606-305e-4fa1-9383-6a252adf75ea" returned: 0 in 0.668s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-a4022606-305e-4fa1-9383-6a252adf75ea" released by "delete_volume" :: held 1.571s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Created reservations ['06ef60cf-2924-4fb6-aeb2-8a3975ed8e6a', '8e0d8d55-0fc2-4b61-80b5-8ed3e02f8c1e', 'b54f7138-3bf4-4395-912d-9c8c5821cac1', 'fec5244e-debf-4b5a-b46d-ac04175f3325'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:53 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:14:53 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:53 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.info" returned: 0 in 0.636s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.463s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:53 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-bb986c15-83d1-466c-a025-54b23b16cb6c tempest-ProjectReaderTests-1048536491 None] Create snapshot completed successfully Jul 03 14:14:54 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.743s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:14:54 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Deleted volume successfully. Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-e63c425f-0779-4230-88dc-bd4b686a134f tempest-ProjectMemberTests-1023125764 None] Lock "cinder-a4022606-305e-4fa1-9383-6a252adf75ea-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (d3dce563-cb93-417a-944e-d1c640875db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064cfcec-018a-4c78-bd49-45ac49296fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064cfcec-018a-4c78-bd49-45ac49296fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-91943339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:55Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3f09d8-9287-4d71-b001-7b57f8e67a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3f09d8-9287-4d71-b001-7b57f8e67a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49dc66f4-8823-4428-9b8d-2f1475f57080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49dc66f4-8823-4428-9b8d-2f1475f57080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2', 'volume_name': 'volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adcea635-5fd2-46ff-8391-649617e29b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adcea635-5fd2-46ff-8391-649617e29b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9781dd-aad7-4c27-ab1c-b238b4d3eeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:54 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Volume bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2', 'volume_size': 1} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-91943339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee05a48baa4319b88d6556eb8983c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:14:55Z,use_quota=True,user_id='9c17f52067804defbfc01582e9e180f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Creating volume bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:14:54 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-9a2fce12-4412-4544-b793-6cae7f63c1b9-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:54 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 1073741824 Jul 03 14:14:54 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Lock "cinder-9a2fce12-4412-4544-b793-6cae7f63c1b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-4e179a32-a8d0-4cde-a125-d1d6c325e9e6" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-4e179a32-a8d0-4cde-a125-d1d6c325e9e6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-9a2fce12-4412-4544-b793-6cae7f63c1b9" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-9a2fce12-4412-4544-b793-6cae7f63c1b9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Deleting offline snapshot 9a2fce12-4412-4544-b793-6cae7f63c1b9 of volume 4e179a32-a8d0-4cde-a125-d1d6c325e9e6 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] snapshot_file for this snap is: volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef5f1a1-2222-413f-afcf-43fe7f608b8b]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:54 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 Jul 03 14:14:54 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:55 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 1073741824" returned: 0 in 0.815s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:55 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 Jul 03 14:14:55 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:55 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9" returned: 0 in 0.894s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:14:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc158dc-414a-4310-9242-963dc8b93cfc]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:55 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 Jul 03 14:14:55 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:56 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2" returned: 0 in 0.654s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=86,cinder:UPDATE=120,cinder:INSERT=37,cinder:DELETE=12 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9781dd-aad7-4c27-ab1c-b238b4d3eeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcb2669-23eb-427b-938c-140fc3f7f106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:14:56 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Volume volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 (bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2): created successfully Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbcb2669-23eb-427b-938c-140fc3f7f106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Flow 'volume_create_manager' (d3dce563-cb93-417a-944e-d1c640875db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:14:56 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-100827c9-6d8d-4649-96d1-1c9fb7908824 tempest-ProjectMemberTests-1023125764 None] Created volume successfully. Jul 03 14:14:56 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6" returned: 0 in 0.805s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:56 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 Jul 03 14:14:56 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] Creating offline snapshot c9b286d7-99b4-4eb0-a767-e3e407c4f952 of volume bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43153d2-3fe3-4a6d-8e92-e72f2dc08ce7]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:56 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 Jul 03 14:14:56 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:57 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9" returned: 0 in 0.739s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:57 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9 Jul 03 14:14:57 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:57 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2" returned: 0 in 0.824s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:57 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 1G Jul 03 14:14:57 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:57 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6.9a2fce12-4412-4544-b793-6cae7f63c1b9" returned: 0 in 0.699s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:57 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-9a2fce12-4412-4544-b793-6cae7f63c1b9" released by "_delete_snapshot" :: held 3.248s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-4e179a32-a8d0-4cde-a125-d1d6c325e9e6" released by "delete_snapshot" :: held 3.271s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:58 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Created reservations ['9b419f80-647d-4a43-8a98-4dc11a1d52d0', '5ff0fd7f-40b5-49ef-8efb-fd3c681ed11d', 'eff822b3-f41d-465b-9fc3-36556c529655', '3e2fce1a-ca69-44b0-bd5b-869842c8fb5b'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:14:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Delete snapshot completed successfully. Jul 03 14:14:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-19b4c5e3-ea1a-4c95-bbf9-4821a0c8cccc tempest-ProjectReaderTests-1048536491 None] Lock "cinder-9a2fce12-4412-4544-b793-6cae7f63c1b9-delete_snapshot" released by "delete_snapshot" :: held 3.413s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:14:58 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 1G" returned: 0 in 0.790s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:58 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 Jul 03 14:14:58 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-4e179a32-a8d0-4cde-a125-d1d6c325e9e6-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-4e179a32-a8d0-4cde-a125-d1d6c325e9e6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "cinder-quobyte-4e179a32-a8d0-4cde-a125-d1d6c325e9e6" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:14:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-4e179a32-a8d0-4cde-a125-d1d6c325e9e6" acquired by "delete_volume" :: waited 0.018s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:14:59 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[13827007-1212-4d74-8422-3d4d10fc76bb]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:14:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:59 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 Jul 03 14:14:59 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:59 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952" returned: 0 in 0.703s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:59 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 is being set with open permissions: ugo+rw Jul 03 14:14:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:59 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 Jul 03 14:14:59 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:59 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952" returned: 0 in 0.679s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:59 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 03 14:14:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6" returned: 0 in 0.871s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:14:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:14:59 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.info Jul 03 14:14:59 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:14:59 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6 Jul 03 14:14:59 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:00 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:00 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.info" returned: 0 in 0.721s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:00 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.info is being set with open permissions: ugo+rw Jul 03 14:15:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4e179a32-a8d0-4cde-a125-d1d6c325e9e6" returned: 0 in 0.719s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:00 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.info Jul 03 14:15:00 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-quobyte-4e179a32-a8d0-4cde-a125-d1d6c325e9e6" released by "delete_volume" :: held 1.655s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:00 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Created reservations ['a3cf2628-adbc-4aff-8739-320dceb5182c', 'c7fab7c9-2895-47c9-8897-0363bcaafcda', '5e71a5da-6690-4d43-ad61-93a04379c928', '7039120c-7fac-480c-90aa-5424262bd918'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:15:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:00 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:15:00 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:01 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.info" returned: 0 in 0.736s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.553s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:01 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-72c343ac-17bd-43f3-87bd-7e893e3e8fad tempest-ProjectMemberTests-1023125764 None] Create snapshot completed successfully Jul 03 14:15:01 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.737s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:01 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:15:01 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Deleted volume successfully. Jul 03 14:15:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-b227cdba-a916-4b96-a91c-5ebc761a8183 tempest-ProjectReaderTests-1048536491 None] Lock "cinder-4e179a32-a8d0-4cde-a125-d1d6c325e9e6-delete_volume" released by "delete_volume" :: held 2.629s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-c9b286d7-99b4-4eb0-a767-e3e407c4f952-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Lock "cinder-c9b286d7-99b4-4eb0-a767-e3e407c4f952-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-c9b286d7-99b4-4eb0-a767-e3e407c4f952" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-c9b286d7-99b4-4eb0-a767-e3e407c4f952" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Deleting offline snapshot c9b286d7-99b4-4eb0-a767-e3e407c4f952 of volume bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:15:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] snapshot_file for this snap is: volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:15:02 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb6ba11-8c22-492d-a073-02b6521958b3]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:02 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 Jul 03 14:15:02 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:03 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952" returned: 0 in 0.875s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:03 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:15:03 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8fb71a-7cfe-448d-bf5f-62541ce4b551]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:03 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 Jul 03 14:15:03 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:04 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:04 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 Jul 03 14:15:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2" returned: 0 in 0.795s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:04 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:04 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952" returned: 0 in 0.779s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:04 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:04 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952 Jul 03 14:15:04 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:05 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:05 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2.c9b286d7-99b4-4eb0-a767-e3e407c4f952" returned: 0 in 0.661s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-c9b286d7-99b4-4eb0-a767-e3e407c4f952" released by "_delete_snapshot" :: held 3.222s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2" released by "delete_snapshot" :: held 3.247s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:05 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Created reservations ['aba75a63-74de-415c-ba6a-57fdc74f8052', 'ce38d3b3-7761-4bfd-83ef-14070a59676b', '54350d97-6118-4775-9bc2-92846abfba9c', 'f684d2c7-a9c7-48fa-8637-642f6cbb2822'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:15:05 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Delete snapshot completed successfully. Jul 03 14:15:05 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-3c5be53e-fe1b-4f21-ae27-9887ec797f1a tempest-ProjectMemberTests-1023125764 None] Lock "cinder-c9b286d7-99b4-4eb0-a767-e3e407c4f952-delete_snapshot" released by "delete_snapshot" :: held 3.391s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "cinder-quobyte-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:06 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2" acquired by "delete_volume" :: waited 0.014s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:06 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca3a286-bf6b-41e2-a549-fa0bfc1451ff]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:06 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:06 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 Jul 03 14:15:06 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:07 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2" returned: 0 in 0.765s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:07 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:07 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2 Jul 03 14:15:07 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:08 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2" returned: 0 in 0.676s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-quobyte-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2" released by "delete_volume" :: held 1.504s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:08 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Created reservations ['7cc2b450-0e42-44de-a961-d74b4ff09af0', '33dd200e-d94c-4819-a9d9-30643b4e367c', 'd283c233-badd-4499-a55a-9df5701e4471', '753855b0-e9eb-4642-ad4e-d65d9731fd54'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:15:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:08 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:08 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:15:08 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:08 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:08 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.666s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:08 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:15:08 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Deleted volume successfully. Jul 03 14:15:08 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-0f00283a-5ac2-48f7-a90a-f4e848fe6506 tempest-ProjectMemberTests-1023125764 None] Lock "cinder-bc60ebfb-94dc-43a5-87fd-c9fa8a996bf2-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:18 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:15:18 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=54,cinder:SELECT=34,cinder:DELETE=5,cinder:INSERT=12 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:15:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:15:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:26 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:15:26 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:26 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.650s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:15:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:15:35 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=1 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:15:38 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:15:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Flow 'volume_create_manager' (d3c0bc56-c510-406c-b6b1-d0675445ccba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6353491-07c3-4e58-9873-6ac56985346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6353491-07c3-4e58-9873-6ac56985346e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1387640614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4963f659-7343-4680-a675-d6542c41df55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74270bf942d459f860dd0877fcb7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:39Z,use_quota=True,user_id='4284e2c60b584b23b7f370efd385f3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25a463c-c865-444a-834e-758016b4b5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25a463c-c865-444a-834e-758016b4b5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:38 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607cc138-11e1-4395-be51-bca00628110a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607cc138-11e1-4395-be51-bca00628110a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4963f659-7343-4680-a675-d6542c41df55', 'volume_name': 'volume-4963f659-7343-4680-a675-d6542c41df55', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473a1be1-6ac0-4505-bc61-d0596d35a8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473a1be1-6ac0-4505-bc61-d0596d35a8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb7949e-d0af-48c2-a2e2-619c1bc8fd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:39 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Volume 4963f659-7343-4680-a675-d6542c41df55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4963f659-7343-4680-a675-d6542c41df55', 'volume_size': 1} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1387640614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4963f659-7343-4680-a675-d6542c41df55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74270bf942d459f860dd0877fcb7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:39Z,use_quota=True,user_id='4284e2c60b584b23b7f370efd385f3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)}" {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Creating volume 4963f659-7343-4680-a675-d6542c41df55 {{(pid=86729) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:15:39 devstack cinder-volume[86729]: INFO cinder.volume.drivers.remotefs [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] casted to osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 1073741824 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:39 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 1073741824 Jul 03 14:15:39 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:39 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 1073741824" returned: 0 in 0.758s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:39 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:39 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 Jul 03 14:15:39 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:40 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55" returned: 0 in 0.604s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:40 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'} {{(pid=86729) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jul 03 14:15:40 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb7949e-d0af-48c2-a2e2-619c1bc8fd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4963f659-7343-4680-a675-d6542c41df55', 'volume_size': 1}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b583c5-74a3-4ac5-a5be-b3a116285b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:40 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Volume volume-4963f659-7343-4680-a675-d6542c41df55 (4963f659-7343-4680-a675-d6542c41df55): created successfully Jul 03 14:15:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b583c5-74a3-4ac5-a5be-b3a116285b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:40 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Flow 'volume_create_manager' (d3c0bc56-c510-406c-b6b1-d0675445ccba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:40 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a73300f5-4f1c-43ba-bd6b-b372db56cd38 tempest-SnapshotDependencyTests-1066367080 None] Created volume successfully. Jul 03 14:15:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:41 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] Creating offline snapshot a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 of volume 4963f659-7343-4680-a675-d6542c41df55 {{(pid=86729) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 14:15:41 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[42237446-82ee-4583-a369-b5e18b0ecbc1]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:41 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 Jul 03 14:15:41 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:41 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55" returned: 0 in 0.702s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:41 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 1G {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:42 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 1G Jul 03 14:15:42 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:42 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 1G" returned: 0 in 0.748s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:42 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4963f659-7343-4680-a675-d6542c41df55 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:42 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4963f659-7343-4680-a675-d6542c41df55 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 Jul 03 14:15:42 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:43 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4963f659-7343-4680-a675-d6542c41df55 -F qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2" returned: 0 in 0.649s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:43 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 is being set with open permissions: ugo+rw Jul 03 14:15:43 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:43 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 Jul 03 14:15:43 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:44 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2" returned: 0 in 0.668s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:44 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.info Jul 03 14:15:44 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:44 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.info" returned: 0 in 0.617s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:44 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.info is being set with open permissions: ugo+rw Jul 03 14:15:44 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.info {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:44 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.info Jul 03 14:15:44 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:45 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.info" returned: 0 in 0.637s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:45 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.102s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:45 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-a8105c2c-2003-4c57-a9cf-af7c0cdda2fd tempest-SnapshotDependencyTests-1066367080 None] Create snapshot completed successfully Jul 03 14:15:46 devstack cinder-volume[86729]: DEBUG cinder.volume.flows.manager.create_volume [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86729) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 03 14:15:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Flow 'volume_create_manager' (4c6c8ffe-fc48-4790-8a2c-8716c65a448f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:46 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280735ca-99f1-49ea-b3b1-c32343156f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280735ca-99f1-49ea-b3b1-c32343156f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-03T12:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c3807e-bd79-49a4-a6ec-3e03415741ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74270bf942d459f860dd0877fcb7d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T12:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T12:15:47Z,use_quota=True,user_id='4284e2c60b584b23b7f370efd385f3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f16dac8-0d93-4fe7-a7bb-ca744107b7a3),volume_type_id=2f16dac8-0d93-4fe7-a7bb-ca744107b7a3)' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb814260-cd54-4e81-9884-fd562c053213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb814260-cd54-4e81-9884-fd562c053213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc9b6b8-1318-438d-be31-bf5e95e4a027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc9b6b8-1318-438d-be31-bf5e95e4a027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '19c3807e-bd79-49a4-a6ec-3e03415741ce', 'volume_name': 'volume-19c3807e-bd79-49a4-a6ec-3e03415741ce', 'volume_size': 1, 'snapshot_id': 'a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bbdb4f-2cc4-4ebc-ac88-30dad67a4dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bbdb4f-2cc4-4ebc-ac88-30dad67a4dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaa65f9-26ca-4ac7-aed7-ba696f04abd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:47 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Volume 19c3807e-bd79-49a4-a6ec-3e03415741ce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-19c3807e-bd79-49a4-a6ec-3e03415741ce', 'volume_size': 1, 'snapshot_id': 'a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2'} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "cinder-quobyte-a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2-19c3807e-bd79-49a4-a6ec-3e03415741ce" by "_create_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-quobyte-a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2-19c3807e-bd79-49a4-a6ec-3e03415741ce" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Creating volume 19c3807e-bd79-49a4-a6ec-3e03415741ce from snapshot a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 {{(pid=86729) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Selected osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26 as target Quobyte volume. {{(pid=86729) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "cinder-quobyte-19c3807e-bd79-49a4-a6ec-3e03415741ce" by "_copy_volume_from_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-quobyte-19c3807e-bd79-49a4-a6ec-3e03415741ce" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] snapshot: a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2, volume: 19c3807e-bd79-49a4-a6ec-3e03415741ce, {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[b453ad58-08eb-4ee6-bab1-4cf29e5064a1]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:47 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 Jul 03 14:15:47 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:47 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2" returned: 0 in 0.797s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4963f659-7343-4680-a675-d6542c41df55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] will copy from snapshot at /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Creating direct copy from snapshot {{(pid=86729) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d505df-f2a6-46a2-a89c-723974a36f20]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:47 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:48 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 Jul 03 14:15:48 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:48 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55" returned: 0 in 0.728s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:48 devstack cinder-volume[86729]: DEBUG cinder.utils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Path /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce not found in is_blk_device check {{(pid=86729) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jul 03 14:15:48 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:48 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce Jul 03 14:15:48 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:53 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce" returned: 0 in 4.429s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:53 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d1f6b1-11a4-41e4-a960-4e755992c0a7]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:53 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:53 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 Jul 03 14:15:53 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:54 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55" returned: 0 in 0.895s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:54 devstack cinder-volume[86729]: DEBUG cinder.image.image_utils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Image conversion details: src /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce {{(pid=86729) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 03 14:15:54 devstack cinder-volume[86729]: INFO cinder.image.image_utils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Converted 1024.00 MB image at 231.15 MB/s Jul 03 14:15:54 devstack cinder-volume[86729]: WARNING cinder.volume.drivers.remotefs [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce is being set with open permissions: ugo+rw Jul 03 14:15:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:54 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce Jul 03 14:15:54 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:54 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce" returned: 0 in 0.630s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-quobyte-19c3807e-bd79-49a4-a6ec-3e03415741ce" released by "_copy_volume_from_snapshot" :: held 7.571s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:54 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-quobyte-a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2-19c3807e-bd79-49a4-a6ec-3e03415741ce" released by "_create_volume_from_snapshot" :: held 7.597s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:54 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.611s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:15:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaa65f9-26ca-4ac7-aed7-ba696f04abd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c3807e-bd79-49a4-a6ec-3e03415741ce', 'volume_size': 1, 'snapshot_id': 'a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2'}' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666cf058-5699-43a3-9670-0ac9440049cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 14:15:54 devstack cinder-volume[86729]: INFO cinder.volume.flows.manager.create_volume [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Volume volume-19c3807e-bd79-49a4-a6ec-3e03415741ce (19c3807e-bd79-49a4-a6ec-3e03415741ce): created successfully Jul 03 14:15:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666cf058-5699-43a3-9670-0ac9440049cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86729) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 14:15:54 devstack cinder-volume[86729]: DEBUG cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Flow 'volume_create_manager' (4c6c8ffe-fc48-4790-8a2c-8716c65a448f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86729) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 14:15:54 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-80e2e7a5-2737-4efd-b742-4b2d852731e9 tempest-SnapshotDependencyTests-1066367080 None] Created volume successfully. Jul 03 14:15:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "cinder-a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2-delete_snapshot" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "cinder-quobyte-4963f659-7343-4680-a675-d6542c41df55" by "delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-quobyte-4963f659-7343-4680-a675-d6542c41df55" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "cinder-quobyte-a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2" by "_delete_snapshot" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:55 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-quobyte-a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Deleting offline snapshot a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 of volume 4963f659-7343-4680-a675-d6542c41df55 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 14:15:55 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] snapshot_file for this snap is: volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 {{(pid=86729) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 14:15:55 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e1a1ff-1651-457f-a56e-34ea3986b6ae]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:55 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:55 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 Jul 03 14:15:55 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:56 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2" returned: 0 in 0.726s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:56 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.remotefs [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4963f659-7343-4680-a675-d6542c41df55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86729) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 14:15:56 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[732c29ab-8f50-4e2b-849f-299ebc2e542e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:56 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:56 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 Jul 03 14:15:56 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:57 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55" returned: 0 in 0.729s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:57 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 Jul 03 14:15:57 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:57 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2" returned: 0 in 0.716s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:57 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:58 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2 Jul 03 14:15:58 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:58 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55.a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2" returned: 0 in 0.614s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-quobyte-a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2" released by "_delete_snapshot" :: held 2.882s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-quobyte-4963f659-7343-4680-a675-d6542c41df55" released by "delete_snapshot" :: held 2.906s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:58 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Created reservations ['db51d2d2-8f3e-4200-895a-ee76ee85ff2b', '55b1b016-ce8b-4b9d-83ea-8c680775ea56', 'e5b1dfbc-76d5-46a6-b66f-9090acd7e5b4', 'cf889266-f40a-43ce-b8ce-c401f0677de2'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:15:58 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Delete snapshot completed successfully. Jul 03 14:15:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-86176e75-139b-404a-9839-6be0fbb9274a tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-a86ad3e8-f5a0-41c0-a11a-f3beb49cdbe2-delete_snapshot" released by "delete_snapshot" :: held 3.024s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:15:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "cinder-4963f659-7343-4680-a675-d6542c41df55-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-4963f659-7343-4680-a675-d6542c41df55-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "cinder-quobyte-4963f659-7343-4680-a675-d6542c41df55" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:15:58 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-quobyte-4963f659-7343-4680-a675-d6542c41df55" acquired by "delete_volume" :: waited 0.013s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:15:58 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f8dbb2-698e-4c52-b1de-164db55bdb0e]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:15:58 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:59 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 Jul 03 14:15:59 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:15:59 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 03 14:15:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55" returned: 0 in 0.750s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:15:59 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:15:59 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55 Jul 03 14:15:59 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:00 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-4963f659-7343-4680-a675-d6542c41df55" returned: 0 in 0.657s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:00 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-quobyte-4963f659-7343-4680-a675-d6542c41df55" released by "delete_volume" :: held 1.463s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:00 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Created reservations ['bcfb0c5a-bbde-47e9-9a6d-03e9968fcf1a', '66062727-1cdd-4e4b-af3b-b629a799ca8e', '934f5468-aa4b-4caf-b958-e67d8f443832', 'cf687b51-c634-42a8-ba55-a6bdfa7ea3a8'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:00 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:00 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:00 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:16:00 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "cinder-19c3807e-bd79-49a4-a6ec-3e03415741ce-delete_volume" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-19c3807e-bd79-49a4-a6ec-3e03415741ce-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:01 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.632s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:01 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:01 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Deleted volume successfully. Jul 03 14:16:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "cinder-quobyte-19c3807e-bd79-49a4-a6ec-3e03415741ce" by "delete_volume" {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 14:16:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-011905b1-11ff-4066-ad20-d76a81b68688 tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-4963f659-7343-4680-a675-d6542c41df55-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:01 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-quobyte-19c3807e-bd79-49a4-a6ec-3e03415741ce" acquired by "delete_volume" :: waited 0.020s {{(pid=86729) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 14:16:01 devstack cinder-volume[86729]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feea84f-a31d-42b3-b413-5d83ea02eb36]: (4, 'qcow2') {{(pid=88039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 14:16:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:01 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce Jul 03 14:16:01 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:01 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce" returned: 0 in 0.735s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:01 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:01 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce Jul 03 14:16:01 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:02 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c/volume-19c3807e-bd79-49a4-a6ec-3e03415741ce" returned: 0 in 0.664s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:02 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-quobyte-19c3807e-bd79-49a4-a6ec-3e03415741ce" released by "delete_volume" :: held 1.436s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:02 devstack cinder-volume[86729]: DEBUG cinder.quota [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Created reservations ['d30f03fc-5bef-487a-82b5-a027aba0ab5d', 'a2384a1a-c58c-44e0-9199-c04c03fbe574', '9d518c2e-0a8a-4365-b536-be57fd0bbc38', '72355c8a-f7a8-4a92-8867-32a92b82d9df'] {{(pid=86729) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 14:16:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:02 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:02 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:02 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:16:02 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:03 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:03 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.622s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:03 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jul 03 14:16:03 devstack cinder-volume[86729]: INFO cinder.volume.manager [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Deleted volume successfully. Jul 03 14:16:03 devstack cinder-volume[86729]: DEBUG cinder.coordination [None req-44518373-96d5-4864-be82-366426602209 tempest-SnapshotDependencyTests-1066367080 None] Lock "cinder-19c3807e-bd79-49a4-a6ec-3e03415741ce-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=86729) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 14:16:12 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:SELECT=25,cinder:UPDATE=28,cinder:DELETE=1,cinder:INSERT=7 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:16:13 devstack cinder-volume[86729]: DEBUG dbcounter [-] [86729] Writing DB stats cinder:UPDATE=28,cinder:INSERT=7,cinder:SELECT=22,cinder:DELETE=4 {{(pid=86729) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 14:16:26 devstack cinder-volume[86729]: DEBUG oslo_service.periodic_task [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86729) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 14:16:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 14:16:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 14:16:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26': None} {{(pid=86729) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 14:16:26 devstack cinder-volume[86729]: DEBUG cinder.volume.drivers.quobyte [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d74c46b0-6dd7-4225-a60e-86b9c9202e26'] {{(pid=86729) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 14:16:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.lockutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86729) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 14:16:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 14:16:26 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c Jul 03 14:16:26 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 14:16:26 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Jul 03 14:16:26 devstack cinder-volume[86729]: DEBUG oslo_concurrency.processutils [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/75d34150e9fbe54c3c7941908b55026c" returned: 0 in 0.681s {{(pid=86729) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 14:16:26 devstack cinder-volume[86729]: DEBUG cinder.manager [None req-0081cdfa-2dd7-44db-b135-6701888913b8 None None] Notifying Schedulers of capabilities ... {{(pid=86729) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}